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' ABSTRACT . , \ , 

' The impact of higher education on the cognitive and 
social development of students was studied in three experiments^. A 
longitudinal comparison of moral reasoning development in the four 
ye*ars after high school among those who did and did not attend 
college vas undertaken. Instruments used were the Reflective judgment 
Questionnaire, the Concept Mastery Tept, the Defining issue's Test, ^ 
and the Sentence Completion Test of ego^ developments Over the first 
two years aftet high school, scores of both groups increased by about 
the sane amount* In the second two years, the increase for the 
college attenders was greater than that for the noaattenders. 
Additionally, a cross-sectional comparison between undergraduates it 
liberal ^rts majors and ^undergrarffuates in engineering majors was 
conducted* On both a measure of verbal reasoning and a measure of 
complex reasoning about issues that have no s,imple right or wrong - 
answer, seniors in both majors sc<Jred higher tHan f reshjaen, • Ihe 
senior-freshmen difference suggested a similar amount of ^g-^OHth in 
both kinds of 'majors^ The third stu4y assessed the impact of graduate 

'education on cognitive and cognitive-social developmental measures* 
Advanced graduate students, first-year gradu2rte students,; and .college 
graduates who had not entered graduate school were compared using 
five instruments measuring reflective judgienj:,, moral reasoning 
development, ego development, verbal reasoning, and socioeconomic 
st>tjis* ,.A,ge and selection appeared to explain differences on the 
meSsures between beginning .and advanced students and between students 
and nonstudents* Theories and research relating to moral development, 
«go development and reflective judgment style are reviewed^ Although, 
methodological flaws in the research are acknowledged,^ among the 
cfpnclusions .are, that people in college grow in moral reasoning (and 
at a fjister rate than non-college attenders) ^ and that college 
seniors do not differ significantly from freshmen i^n tego development* 
A bibliography is appended*, (Author/SH) 
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Abstract 



I. 



Bus'l^roject focused ort .the impact of higher education on the 
. cognitive* and social development of students. Study 1 was a longitudinal 
comparison of moral reasoning development in the four years after high - • 
schoot-ambng those ^ho did and. did n6t go on to* colle&e • Over 
the fitst two years^ aft^r^Jiigh school, scores of both groups increased 
by aboi^t the same amount. In the second two'ypars, the increase for ' 

• 4 

the college attenders was greater than that for the nonattenders\ 
Studx. 2 contained a cross-sectional comparisoij between undergraduates ' 
in 'liberal arts maj'brs ^n<J undergraduates in engineering Mnajors, ^ 
On both a measure *pf verbal . reasoning and a measure of complex reasoning 
about. issues which have nO simple ^right or wrong ^nswer, seniors in both 
majors scored higher than freshman/ Th6* senior-freshman difference 
suggested a similar ^amount of growth in both kinde of majors. On 
measures of moral reasoning, personality development and two measures " > 
of cognitive development in 'Study 3, beginning and advancjM graduate* ^ 
students differed by no more than two adult control groups.* Results a 

i , ♦ 

in Study 3 suggested that the observed differences between beginning ^nd 
advanced graduate students were attributable to age and selection, , ; 
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\fliat we should' seek to impart in our colleges^' therefore, is ^ 
hot much learning, itself as the s^^irit of lea/ning. It 'consists . 
in th^ power to distinguish good reasoning from bad, in the power ta 
digest and interpret evidence^ J.n.a habit ^df catholic observa^on and 
a preference for 'a nonpai^tisan point of view,' in an addiction to ' . 
clear and logical processes of thought and yet an instinctive desir.^ 
to interprets rather than stick to the letter x)f reasoning > / 
(Woodrow' Wilspn, 1909) • ^ ^ 

There are at least two kinds of intellectual questions. , The first we 
shall call intellectual puzzles . Thes6 are questions for wfiicrh evid&nce and 
tae. rules of logic dictate a single, verifiable correct answer ♦ An example 

. — r ■ -4' ■ ' 

is "v625 = These are the kinds of questions with which most standardized 
tests deal/ ' - ' , « ^ 

But there is a second kind of intellectual question, which we s'hall call 
intellectua l pro blen\s> These are questions which do -not have a single,, 

Je ij 

or 'because It is contradictory. An exajnple is "What proportion Of America's 

energy needs tan be met by solar energy in th^' 19810s?" Tkere is evidence 

which can be brought to' bear on this issue, estimates of how much energy , 

American will need, estimates *of how much of that need cati be met by fossil 

fuel sources, an^ estimates of how' much energy mighty be produced by solar 

technology.- But!the estimates made by different experte .are inconsistent, 

r ' ' ' 
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verifiable correct answer^ because the evidence on the is sile is incomplete' 

ropo 



partly because the evidence which chn bjs use.d iir making those estimates is myt , 



sufficiently complete to dictate a single, logically verifiable, corredt estimate. 
Higher education courses deal both with int6?llfectual problems and i 

intellectual puzzles. For instance, elementary calculus courses, physics. 

* ^ * * 

courses,^ and chemistry courses train students to solve equations or balance 

equations in a manner which wi^ 'yield the correct ^aIlsw^r. Courses^in 
psychologjL, history,, philosophy, and literarture^ (to oame j.ust a* iew) force ' ' 
Tthe in^Tividiial to confront intellectual, problems' of historical interpretation, 

per$onal identity, social planning, and* moral^ values whidh have no single, 

' ' " ^ ' ^ ' \ " ' ' ^ ' " 

•correct answer. We shall use the term xeflective judgmeat to refer to an 

> . ^ , J 52 , , . . ^ ^ 

individual's own answer to an 'intellectual problems, bebause ^uch answers , . 

are ma-de after reflection on the available evidence, but tSey are jud^ents 

which go beyond that evidence. We sh-all use th'e term reflective judgment ^ ^ 

style to mean the*^ay in which a persqn reasons about complex .ptoblems^having ,^ 

no single correct answer, ' • " , ^ , ' * ^ 

The research in this project focused on 'the relationship betweerr.hlgher ^ 

• , • ■ ' . . y / ^ 
education and' the way an individual reasons- about intellectual-'probleuis. In ' 

addition, it focused on the relationship between higher education and three 

'^ther cognitive varia\)les which the literature suggests should ^be ^related 

^ \ . \^ ^ $ 

to the development of reflective judgment styij^e. Those* three variables 

are verbal reasoning (the ability to solve verbal Intellectual puzzles as 

* r ♦ 

. * , , 

tapped by, coiwentional standardized tfests), moral development, and ego 
development, ^ ■ • % ^ */ 

" . Three of the va^riabLes in this project, ego development, moral development,* 
, and *Vetlective* judgment , are whatj^Jwe? sha^ ^call cognitive-social variables. By 



cogMtive-spciibl, wc mean that the variables involve the individual^ s ^nder-. 

^ • ^ ' 

standing Qf the people in his/her .social envirofiment and his/her own 
^•elationship to those peopl*e. As will become clearer when we, explain the 

' theories on which our work is based, ego development, moral development, and 
Inflective judgment aire cognitive-social variables by this definition* As 

-'^^^Cab^e 2 shows, the' individual's perception of interpersonal relationships 
isL one of four aspects of ego development* Moral development involves the 
maturing of understanding about the principles which govern interpersonal 
transactionjp. And the highest levels of reflective judgment (see Table 1) 
presume an understanding of how other people think aboyt complex issues* 

\ln presenting the rest of the background for the project, ve, shall follow 

' • ' <p . ^ • ^- ' . 

' this outline. First we shall briefly describ.e the theories of moral 

'development, ego development, *an"d reflettive judgment style out. of 'which 
this research grew. We. shall emphasize links between the theories, because 
these links have.- die tasted our choice .of research measures. Sejcond,' we shall 

. briefly describe 'tfepfiiost relevant empirical res. .arch in the areas of 
reflective judgment style, mor^l development, _and ego development. This 

^ reyiew' mus t be highly selective, because th^ literature in these areas is , 
so axtfensive. * ^ • • 



Theories . * " ' , * 

"""^ * » . ,^ 

— \ 

, • '.Our work grows ^irectly put of King (1977) and JCitchener ' s (1970)' 
. adaptation of William Per-ry^s (1970) theory of intellecjtual and etjg-qal 
dev^elopment in the colleg^e ye^rs, Kohlberg's (1969., 1971) theory ofuforal 
development, and Loevinger^s (1970) theory of ego development. All three 



theories will be briefly described, along with the linka between them. - 

^ All three of - these theories are developmental stage theories. By 
basing our research on stage conceptions, we do not wish to espouse an 
overly simplistic theoretical conception^ particularly a conception which 
describes an individual as reasoning at one and only one stage. According 
to our conception (Oavison, 1977; Davison et al., 1978, 19S0; Rest, 1979), 
the stage descriptors depict type? of reasoning. Any given persoA will 
typically use different types of reas'bning under different circ*umstances. 
Con^rsely in a given circumstance, different people will use different types 
of reasoning. l^Hiile we ^.can not characterize an individual by a jiumber repre- 
senting the level of reasoning always used by that^ person, the object of 
sta^e developmental measurement is to describe each individual by an index 
characterizing his/her "average" level of reasoning in a variety of circum-" 
stances. In oxxr conception, .the stage types are ordered "^^Ln that (1) types 
of reasoning which are adjacent in the stage hierarchy are logically more 
similar than those which are nonadjacent and (2) people who frequently use 
a given atage, ar^ more likely to use stages adjacent to that given sta^e 

nonadjacent to the- given stage (^ee Davison, 1977; 
Davison, et al. , -1978; Davison & Rpbbins, Note 2; Rest, 1973^. 

^ King (1977) and Kitchener (1977) have jointly devised a more specific 
framework called Reflective Judgment which focuses on epistemological 
developjnent. Influenced by the work of the philosophers Popper (1972), 
Kuhn (1970),^ and Dewey (1^3), as well as psychologi^sts Perry (1968), Boyd ■ 
(1972), Riegel (1973), and B^oughton (1975), King and Kitchener have argued 
persuasively that intellectual^development continues beyond relativism/ 



than to use stages 



' Descriptidn of Reasoning Characterizing Each Position 

■ * . r • 

' ^ in Reflective. Judgment 

^ : L_ : 



Position d - ' 

Subjects use, simple black and white, excrete, 'and categorical thinking. 

Knowledge is s^en as ,abs6lute, a'nd authorities are seen as the source of 

knowledge. Problems are solved simply by following the work of an 

# . ^ • ^ ' 

authority, rules, tradition, or the norm. Judgement is seen as unnecessary;' 

S, * * IN 

sincfe alternatives are not acknowledged. • ' * * 



l^osition '2 ^ ^ 

Subjects perceive alternative vie\>?s,x^but reject them without critical 

examination. They believ^that the truth exis-ta ^nd that authorities 

usually know^ the truth. Th^ir arguments are simple and frequently illogical. 

♦ ' * t 

, ' f J - , . ^ , 

They may dffer pieces' pf unrelated information as "evidence," and then 
choose a point of view, on th^ basis *of tradition or authority. -They^Ttiay 
also cite e\^id^nce which contradicts th^ view they endorse without / 
"acknowledging the contradiction. , • i> 

P^osition 3 

Subjects acknowledge the existence 'and temporary legitimacy of different 
views. Authority and knojwledge become further separated, and they begin 
to see auth9rities as "biased" or arbitrary* With formerly-held absolutes ^ 
no longer intact j the contingent nature of Jcnowledge is tconf using, as is « 
.decision-making. Everyone's view is-.seen as equally correct an^/or 
eqoially biased. Decisions are based predominantl>^ on personal beli<ef or bias.« 



• ♦ # / 

Positiqfi 4 ' 

Subjects acknowledge the la^ck of absolutes in some areas, but not in others'. 

\ 

V 

•^ey bei^,in ^o evaluate evidence, but do not understand that evidence entails a 
.conclusion, vjliey use both unsupported belief and evidence in decision-making-. 
^ Subjects are often skeptical about the ''truth value" ol any evidente or an ' 

« \ 

authority's opinion, ^and* they deny that opinions or interpretations can be • . 
, object ively* evaluated. t ^ 

position 5 \ ' 

Subjects begin to understand that knowledge is embedded in a (context and that 

a frame of 'reference is important for understanding a point of view. Authoirities 

^ began to be s^en as experts who have reasoned, to a point of view which may or * 

'may not be valid. Subjects evaluate evidence on sdveral sides of issues and 

•from several perspectives. The^ present a- balanced view, but they do not 

integrate evidence into their own view. * ' { ^ ' ^ ^ 

* * * ^ * 

Position 6 ' * ■ ' . • 

Subjects see knowledge a.; embedded in" a context and are beginning to .unders tand 

that not all points of view are equally correct. They can analyze evidence fbr " 

alternative points of view and may argue on the basis W evidence that one is 

more likely. They do not. synthesize the ^evidence into, a view of'^heir own, 

'however. Usually, they rely o^i the synthesis of others (e.g., pxperts)', whose * 

views are alsd seen as open fo evaluatign^^, * 

Position 7 . - 



4g . 
J 



• Subjects present an examined point of vi^w which they endorse. It is based*on 

an integration and logical evaluation of evidence, the opinions of experts, as 

well as reasoned conjecture about "//hat appears to be. truife." They are, however, 

, willing to Acknowledge that theiV views nmy be falsified and may need to be re- 

formulated in li^^ht^of additional eviJence^at a futiire time. Their( point of -view 

is presented as bein^^ probably correct and seems to presume a probabilistic or 

fallibilistic view of knowledge. 
Adapted fr<im Ki^tchener, 1977-. 



♦ 

^ Keeping the major tenets of relativism in ml'hd, that truth exist.> wltliin a 

context and may be seen as suhjectivfe, King ana ^Kitchenet reefer' to philosophy 

» * * "* ^ 

of science in deriving their upper stages. Taey ooscrve that liie -is similar 

to $'^ience in that one must often make decisiuns on the basis of incomplete 

or even conflicting information. ♦The scientist is aided ^.n tnio dilemma by 

^ *a philosophy qf science which helps to provide a w^y Oi.' understanding and 

jt • • • - 

> 

judging how CHie may choose one way of thinking over another '« If one -Cannot 
say for certain which theory, in/erprfetation, or observation is correc t, . 

. • Jy ' • - . : " • 

^ philosophy of science suggests oae. mi-^ht take action on tlie basis of. which is 
^ more probable > Appropriately^ then, King and Kitchener have termed the final 
stage, in Reflective Judgment "prubabilism." Probabilistic thinking can be 

characterized ga^-follows:^ • ^ . . 

• - • . <* 

*1. Judgements are made cQnsciously ancl deliberated with 

» re^flecfion and thoughtful, consideration, ate riot automatic, 
t * imposed, ^nor unconsidered, ' ' - ^ 

' -Probabilistic judgements are based on Veasons and' ilse , ' 

■ ■ 1^ ■ ■ 

^^^■k empirical evidence and/or logic »t:o. support conclusions* 



3. A person 'making a probabilistic judgement evaluates 

evidence from aTnumbBr of perspectives > ,ackaowled,i,es' the 
relationships among elements, and synthesizes evidence into 
^ coherent, personally meaningful view. 
,4. 'Logic and evidence is followed through lEo 'a reasoned 

conclusion by integrating ^Idence, ^experts' opinions, and 
one's own experiences. V " - * 

5. Reasoninj^ tlfat ^iv^^robabilistic lea^s one to form a - 
qualified^ judgejnent that, though it may be firiitly held. 



V,. ■ 
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is^not irr^evocable and may be revised or reconsidered in . 

'the light of new evidence'*. 

In sum, Refle(itive Judgement is a scheme devised by King (1977) and y . ^ 

Kitchener (1977)' to trace* the development' of cbmplex reasoning and ' . 

judgement-making. ' . 

Perry.aclcftowledges a* close association between ^his theory and that -of 

Kohlberg (,1969, 1971)- Both theories represent sfa^e models. More importantly^ 

. ' % \ . ' ' , 

however, botli describe changes in the way people reason about questions which 

have no single correct answer.. Kohlberg's theory differs, however, in that'it 

^eals solely witlinnoral issues.- Kohlberg has a six stage theory. of moral ^ 

development* At each stage, there is *a different basis for makijig moral Iflec^sions 

Moving through t^he stages in order, those ba5es<are'(l) reward," punishment 

and obfedience, (2) instrumental hedonism and toacrete reciprocity, (3) main- 

* \ * . 

tenaace of interpersonal relationg and mutuality, (4") maintenance of social 
order, fixed rples/ ahd authority,* (5A) "social cont^ract', (5B^ higher law and" ^ 
conscience, and (6) . universal ethical principles* 0a2 hypothesis of 6his. 
Research is that the college years are a time in which persons begin to reason 
more at the upper stages. and leas .at the lower staged* In other words, it is 
a ^ime in ^Chich people change the waj taey reason aljout moral issues* This 
change in the way they redsoti about moral issues is linked to change? in tKe 
way. the^ make reflective juiigmen^ts. 



Perry also acknowledged links' between his thecTry and Loevinger's t^ory 



of ego development* .Again,, some the siihilari'ty arises from the fact that 
bo^th are stage theories. However,^ there are more important similarities, /- 
According to Loevingef, .cognitive style is one of four e^ development strands, 

and her concept of co^ni*ti.ve s^y \e clo sely parallels Perry's concept of 

». . ' * ' • 

intellectual development-. A third ^' link, atises from the possibility that the 



10 



formation of dgo identity is an integral part of Perry's commitment. Table 
1 outlines Ijoevinger's concept of ego*;development in 'Some detail. In brief, 

< ^ , 

her e'^o development .is a construct 

which assumes that each peroon has a customary orientation 
. to self and to the world ano' that there is a continuum ^ 
(ego development) along whicrf these frames' of reference 
; can be arrayed. 'In general, ego development is marked 

^ ' by k more differentiated perceptiop of one '^s self, of the . 

social woVld, and of .the relations of one's feelings , . * 

and thoughts to those of others' (Candee, 1974, p. 621) ^ 

X V 

. ." . Ego development, then is a central construct which 
refers to -stages of development which include what* * 
others have called 'moralization, ' 'integration,' 
'relatability, ' and ^'cognitive complexity.' (Hausen,' 
1976, 929-930). , ^ ; 

empirical Research " * 

As stated above, the Research leading up to our projecl: on- ego development, 
moral de\/elopment , anu/ reflective judgment^is too extensive to summarize in 

any detail. We will focus on Ipri^dtudinal, cro$s-sectional, and educational 

, • • «• , 

interventiori studies, »because they" seem most relevant to our project. » 

Vavious cross-sectional studies of ego development generally have dis- \. 



\ 



covered a positive association between age and scores on Lo^vinger's measure ^* 

^ ' of ego development (Haan, Stroud", & Holstein, 1973; Lamb'ert, 1972; Loevihger 

& Wessler, 1970; Redmore &• Waldman,, 1975; Sullivan, McCullough, & Stager, 

" ,1970; king, Kitchaner, Parker, '& Davison, (Notj^ 3). All but two of these studies 

^(Haan«et al., 1973; and King, et al* , Note 3) were carried but ov^'r aq age range 

which spanneu the junior high and* high school years rather thcin the cdllege 7ears; 
• • * 

ERIC , ^ , , 13 ^ * . 
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In prior work, the principle inveseTgators (King, Kitchener, Parker, & 
Davison, Note 3) found ^o differences between high school, college, and 
graduate* students matched in terms of j^erbal reasoui/ig skills. Table 3 ^ 
saovs the mean ego level scores found by King et al, Haan et al. (L973) found 
a hig^her level of ego development in ypung adults than in late adolescent.^, 
iiirichson (Note 4) fuund a gradual rise in ego Icv^l^in a four year longitud-* 
inal study of 20 adult women. The picture that emerges from. these longitudinal 
ana cross-sectional" studies is that ego level is highly correlated witli 

9 » 

age (.74 and .64 respectively among boys and girls studied by Loevinger & , 
Wesslef, 1970), but tiiat'^i^o.JrevVi. changes- slowly with age,* .For instance, 
Sullivan et al. fuund a meau difference of o|^ly' 1.2 ego stages* between 
youngsters five years apart in age** Ericsson ^Note' 4) found a mean difference 
of less than a stage ia her four year longitudinal study. * Redmore- and 

Waldman (1975) found similarly small differences over a 4 year age range 

' • • • * 

(15 to 19 years old), • \ ^ 

Given a variable like ego development which seems to change so slowly over 
time, it seems doubtful that any short term educational program could yield 

, 4 

large changes in ego level. Hurt (1974) found that two experimental groups 

changed significantly and a control group did not. But the three groups did 

not differ significantly on a post-tejt, and the largest meap change in any 

group* was less than oae-half of a stage, Bereiner (1976) found no change 

pre- to post- in his study of the effects of education on eLo level, trickson 

(1^73) also found no significant improvement pre- to post- in her experimental 

^roup, (uhe did fiad that experimental subjects were higher -than control sab- 

jects on the post-test, but onl^oecause control scores dropped pre- to posc- 
} o ' ' " • 

whereas experimental subjects reTnaineaN;he same.) From these cross-secf ional, 
longitudinal, anu intervention studies, we conclude (a) that ego development 
changes slowly wJLth age and (b) short-term educational programs have yielded 



14 



.« 12 . ■ 

modest improvements at best in ego level. ^ 

The research on myral development during the college years is more extensive. 

TwQ of the researchers on this project (Rest, Daviso^n, & Robblns, 1978) have 

X completed a review- of longitudinal and cross-sectional studies using the 

^D efining Issues Test , an objective test of moral judgment' based on Kohlberg's 

theory. Even using time intervals as short as two years, consistent upward 

trends were observed in both cross-sectional and longitudinal studies. Age 

trends accounted for more variance than either 'cohort or time of testing effects* 
' ' ' ' ^. ' 

Consistent upward age trerids have also been observed using Kohlberg^s own inteir- 

\i ^ . 

view measure (polstein, 1976; .Kohlberg, 1969; Kuhn, 1976), although Kuhn observed 
no significant change until a full year had passed. Rest {Note 5) found that 
level of education was more hi^ly correlated with moral judgment scores than 
* wastage, a finding which points to an educational influence on moral judgment. 
In the initial testing of our longitudinal study, we too found significant 
difierencea between our high school, college, hnd graduate students (see Table 3). 

A sufficiently* large number of studies involving moral education intdrven^ 
tions have now been published that Lockwood CNote 6) and Lawrence (Note 7) have 

* * completed reviews of these studies. Considering just those studies where the 
research methodology seemed adequa^, LocTcwood concluded that such programs 
.seemed to yield small, but significant upward shifts in moral reasoning. Law- 
rence remained so skeptical about the research methodologies employed, that she 
drew no conclusion. Even wher.e upward shifts were observed the changes were 
typically less than one-tenth to one-twentieth of the measure's range. Like 
Lockwood, we conclude that even short "term moral education programs seem to • 

/ produce small upward shifts in reasoning. ' 

In cross-sectional studies of reflective judgment, Meyer (1^75) found 

♦ 

..Significant /iifferences between college freshmen and juniors;^ the mean 
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Tabl^2 - . 

Interpersonal Style and Conscious Preoccupations Characteristic 
of Each Stage in Loevinge-r's Theory of Ego^ Development • * 



Stage 

I-l- 

1-2 



1-3 



1-3/4 



1-4 



1-4/5 



1-5 



1-6 

NOTE: 
NOTL: 



Interpersonal Style 
Symbiotic ^ 
Receiving, dependent, 
exploitive * * 

Wary, manipulative exploitive' 

Belonging, superficial 
niceness 

Aware of self in relation to 
' group y .helping \ 
Intensive, responsible, mutual, 
concern for communication 

Add: /Dependence as an emotional 
problem 

% 

e 

* « o 

Add: Rfespect for autonomy, ^ 
interdependence , 



Add: Cherishing of individuality 



Conscious Preoccupation s . \ 
Self v§. non-self ^ 
Bodily feelings, -especially 
sexual and aggressive 
Self-protection, .trouble, wishes, 
things, advantage, control 
Appea^a«ce, social Acceptability, 
banal feelings, behavior 
Adjustment, problems, reasons, ] 
opportunities 

Differentiated feelings, motives 
for behavior*, self-respect,* 
achievements, traits,^ expression 
Add: Development, social problems, 
differentiation of inner life * 
from outer 

Add;^ Vividly conveyed feelings, 
integt?ation of physiological and 
psychological, psjychological causa- 



tion of behavior, 
sll^fulfillmen 
context 

Add: Identity 



role conception, 
social 



L ,1 LUFxc v;ui 

t. Self in 



**Add" means in addition to the description applying to the previous level. 
Adapted from Loevinger (1976) pages*25 and 26., 
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Table 3 ■ ^ . ' . 

Means and Standard ^^viations of the Concept >tastery Test^ Defining Issues 
Test Moral Development, Sentence^ Completion Test of Ego Development, 
and Reflective Judgment In\:^rvieV in the Initial Testing of Study 1 



X 
S 



Concept Mastery Scores by Samj^le 



High School 



42:2& 
16,83 



College 
84.11 
23.36 



Graduate 
111.37 ' 
33.34 



Xj^ SCORE 
SCORE • 



Defining IssueJ Test Scores by Sample 

High School . Collet,e Graduate 

23.39 '26:61 30.40 " 

5.38' 6.70 6".18 



s 



Sentence Completion Test Scores by Sample 

Uiih School College Graduate 

35.23 ' 37.94 , • 36.05 

4.85 4.35 ' 4.27 
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^ Reflective Judgment Interviev/ Scores by Group 



High School 



2.77 
.49 



College 
3.64 
.81 



Graduate 
5.67 
.92 



** 



Group 'means y/ere significantly di-fferent at' the .01 level. 



difference Corresponded to about 1 stage position. Even crfCer cuntrollirig foi; 
differences in verbal reasoning abilities, Kitchener (1977) ♦found signlf icajft"' 

differences .between \\i^h scnool juniors, college juniorV/and j^radua-te stud,ent§' 

' ^ f 

(see Table, 3). Blake (Note 9) found a small, but significant upward' trend in' 

average' Perry position scores from .the freshman to the junior years with a sli^^t 

drop during the senior year. KurfioS (1973) found no difierences betwaep'her 

♦ 

freshmen and juniors, but her measuring instrument was quite unlil^ that used 
in other studies. With ,the exception of the Kur^iss stucly , ^older , bet Ler^ educa-^ 
'ted subjects seem to display higher stage levels of reflective judgment. Mean 
differences seldom exceed one st^ge .over a two year petiqd, except in Perry's 
original atudy. It is not clear to 'what eijctent' these age-eaucation differences 

are aue to maturation or education. 

1 

A number <t educational interventions have^ been based on Perry's scheme 

(Widici:, Knefelkamp, & Parker, L975; Touchton, Werthermer, Cornfield, & 
\ 

Harrisen, 1976; Stepheilsen & Hunt, 1977; .adick & Simpson^ Note 10). Waere 

control groups were used, the experlm-mtal groups seeued to have shifted upv^aru 

more than controls. But the significance of theae differences was not always ^ 

tested. Lione of the mean diffierences were as large as a single stage. Results 

of taese studied weakly suggest the conclusion titjat short-tena' interventions 

» . 

have amall Upward effects on 'reflective judgment atyles* 



Meaf5 uremj|nt iiethod s . / . 

V/e used the Reflective Judgment Interview and three questionnaires, the 
concept Mastery Test, tae^ Defining Issues Test, and. the Sentence Completion 
Tost of ego development. All* f ouf instruments will be uescribed in alphaoetical 

order. Buffirst a word about w'ay wer have selected the three Measures of 

' 

coi.,ni£ive~social development which we have chtii^en. Questions having no single 

I, 

on^wer <irise in m^ny (not necessarily mutuailly exclusive), donaino. The tiiree^^ 
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cognitive-sociar measures were chosen 1o assess reasoning in several of these 



domains. The Sentence Completion Test of 
personal issues. The Defining Issues Tes; 
Reflective Judgment Interview deals with 
scientific issues. We chose these cognit: 
seeraed-to tap complex reasoning about con 
broad -range of domains. 



ego development deals primarily with, 
t deals with moral issues, and the 
social, historical, religious and 
ive-social measures because they, 
plex intellectual problems in a 



'The Concept Mastery Test (Terwan, 1973) is an objective, paper-pencil test 

of verbal reasoning ability., the ability ,tio solve^ verbal puzzles which have a 

single correct answer. The kinds of questions included on^the test closely 

parallel those found on standard paper-pendil measures* of verbal intelligence, 

except that the Concept Mastery Test (CMT) Ijis designed to discriminate among 

v. » 

people at the very highest leyels of verbal \reasoning. It contains two 
sections. In Section I, the examinee is presented two words and must correctly 
determihe whether those two words are>syilQnyms or antonyms. In Section II, the 
examinee must correctly answer analogous puzzles, such as '*cat is to kitten as 
dog is to '(puppy)." While the reliability variles depending, on the sample and 
•the type of coefficient used, the internal consistency ^reliabilities generally '\ 
seem to be 14;^ the low .90s while the test-retest reliabilities generally fall in 
the .80s (Terman, 1973). The test takes abdut 40 minutes to administer, t^ere.. 

♦ 

gr^up differences were found on ot-her measures, the analysis of cbvariance and 
CMT scores were used to assess whether or not those group differences on 
other meas;ures^ could be attributed to differences in conventional verbal reasoning" 
sikllls. * CMT scores were aiso ifsed to assess whether people entering different 
educational programs begin with different levels of verbal reasoning skill. _ " 
The Defining Issues Test (DIT) i*s an objective test of moij^^. development^ 
based on Kohlberg's theory (Rest, Cooper, Coder, Masanz, & Anderson, 197A; 
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Rest, 1975; Rest, Note ll) . It is composed of six stories each describing 

a moral dilemma. Following a dilemma are 12 moral issues each corresponding ^ 

to, a s£age in Kohlberg' s theory . ^The examinee must rate each issue in terms 

of 'importance and rank order his/her four most important issuesl The test 

• yields 6 stage scores, each indicating how much* importance the subject 

.J. attaches ,t6 'issues keyed to Stages 2, 3, 4, 5A, 5B, and 6 respectively • 

^ in Kolilberg's th^ry. In*addition it yield^ a P score which is simply the 

sum of st^ge scores 5A, 5B, and 6 and which indicates how much importance 

the subject attaches to Kohlberg's Principled Issues (issues characteristic 
• % 

of Stages 5 and 6). And it yields an lYidex of overall moral developme'nt 

levelj called the D score^ Davison and Robbins . (1978) report that the 

internal consistency ^reliability of the D score is in the .SOs while test- . 

retest reliabilities generally fall in the •70s or •80s. The test takes 

40 to 50 minutes to administer. / • . v 

The Reflective Judgment Interview was developed by two students of 
t. ' . - 

the principle,. investigators. King (1977) and Kitchener (1977). It consists 

of four intellectual problems with no unique corrects answer; one t^roblem 

in historical interpretation, one on the objectivity of journalism, one 

on scientific and religious explanations of creation; and one pn chemical 

additives in foqds. Each problem contains two statements describing 



oJ>5»osing positions on the issue. After hearing each problep, the examinee 
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verbally answers several questions, such as "What do you think about these 

<. • ^ • • * 

-statements?", "On x^hat do you base your point of view?", and "Can you ever 

» " ^ ♦ 

know^fpr *sure that your position is correct?"* Responses to each problem 

are scored for the position in the scheme which best *seems to charac-- * 

terize the response. An .examinee's total score is ^^he average of the 



four problem scores. King (1977) obtained internal consistency (Cronbach's 
alpha) reliability estimates, ranging from .84 to .96 depending on^^f grou^. 
No tQSt-retest ^reliability estimate is available. InteXrater reliabilities 
ranged from .68 to .96 and interrater agreement coef f icj.ents (Lawles & Lu, 

' ' * ' . . ' ' . ' * • 

.197?) ranged>^frt^m^-.59 to ,77, ' , ^' v, 

ijhe last instrument'to be used in this research is Loevirtger's Sentence 
Completion Test of Ego Development (Loevinge?: & Wessier, 1970; Loevinger,, 
Wess]|er, & Redmore, 1970), There are two forms of 'this instrument, one 
for men and one for women, Both forms contain 36 sentence stems to*be ' 
completed by , the examinee. Each s^ntencfe completion is rated for ego lev.el 
(a level in Loevinger's theory) and the 36 item scores are combined into 
a com{)Osite, Loevinger & Wessier (1970) report an int-errater reliability 
of ;86 and an interrater agreetnent of 6l%, Redmore and W^^dman (1975) 
obtained internal consistency reliabilities ranging from .80 to .89. * * 
Test- re.t^st" reliabilities in this same study .ranged from .44 t;o .91^ * . 
depending. on the .sample and the scoring method used. ■ ' * ' . 

This report' focuses on' th'ree major studies in our project. "The fArst 
is an extension of a longitudinal study in which James Hest examined the 
moral re"asoning development of.^people who did and did not go on to college 
after high school to^assess whether one or the other, group was changing 
faster. The study covered the four years itranediateiy following; high 
school, ^ Thi^ study is more fully reported in Project Report 3!fl, "Th^ 
impact of* higher education 6n raoral reasoning de\^elopment» " a. * - 
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The* sefond study summarized here is more fulljr- reported in Project 

Report //3, "Reflective judgment and its relationship tp ac^demitf field." 

It is a cross-sect^.onal comparison of students in engineering majors 
, *. ' , 

and liberal arts majors on two instruments, the Concept Mastery Tes^ and 



the Refledtive Judgment Interview. The purpose of this study was to assess 
i^he.ther freshmen to senior changes on the two Instruments were larger in 
the liberal. arts majors than in the engineering majors.* Tlie'last study 
is a cross-sectional comparison of people with bachelor's degre^ who 
^did ^.nd dl^ not go on to graduate school. All four measures, the Concept 

\ ^ a i, 

Mastery Test, the Reflective Judgment Interviex^, a the 'defining Issues 

T^st, and the Sentence^omplet?ion Test were used in this study^ ' Our; ^ 

purpose <^as to investigate whether those who went on to gradusTte gichool 

seemed to be undergoing larger changes, • . . ' . * 

The remainder of this report is divided into f^ve sections. The first ^ 

three describe the Xhree studies outlined above. The fourth sUnnnarize^s . 

/ ' ' " S 

our attempts to disseminatip project' results , And the last- gives our ^. 
coTicXusions^and suggestions for future research. •* 

Study I 

In his study 6f children's moral judgment,^ Piaget (1932/l965) 
empha.^ized peer interaction as the crucial experience leading to development, 
Kohlberg (1969) hypothesized that not only peer interaction but, also "role 
taking" experiences contributed £o moral judgment developm^t*. "Role 

0 

* taking" experiences include taking resppnsibility for-dthers, participation 
/,in social organizations and institutions, democratic parent-child discussions 
as well as give-and-take amo^ng .fleers , Neither Piaget not , Kohlberg , 
eifibhasizes higher education as. a facilitator of moral judgment development. 
Their deemphasis on formal education possibly deriyes froijj the emphasis. 

that the.."socialization" view placed on direct teachingT-rcognit^Ve 

/ ■ * ' • 

^ developmentalxsts xfant to depict development in terms of internarl trans- 
formations and reconstructions of -experience, not 'in terms of ^'d^ect. learning 
In moral ^dgment research using the Defining^ Issues Test ("DIT^), 
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higher education has been a* strong correlate of moral judgment. Table 
4 shows the average DIT scores for four student groups: .the more 
•educationally advanced groups have higher moral judgment scores . 

Table 4 

Average Moral judgment Scores of Student Groups 

' 



StudenJ, Group 

4 

^ ^ 


Average DIT 
(P-index) 

— * 


Number of 
Subjects in' 
Sa^nple 


Junior high students 


• 21.9 


' 1322 


/ 






Senior .high students 


31.8 


581 


College ^students' 


' ' 42.8 ■' 


2479 


Graduate schoo.], students 


5'3.3 

» 


. 183~ 









In s-everal studies t)f adultsV tSie correlations of DIT scpres^^^th 
educaticm are higher than for age: Coder (1975) foun'^^^a negative correlation 
with =^ -10) and a^positive correlation with education (_r*= .25); 

Crowder (1976) found correlations of* -.0^ and .25, respectively:. G*. Rest 
(1077) found a correlation of .45 with education; and Dortzbach (1975) 
found a negative correlation with age. and a positive correlation V7ith 
education. Furthermore, cross sectional data suggest that adults seem 
tp plateau in moral judgment devoJ-opment after they end their formal 
schooling. If adults are grouped according to the highest level of formal 
education attained, " the' average DIT scores are comparable to the average DIT* 
scores of students currently aL that 'level (for instancfe, current high school 



21 



■ • ■ ) 

Students average about the same as adults witn high school edercations but ^jho 

are in their AOs, 50s, or 60s). In otlier words, forma^ creation seen^*'to 

be strongly associated with moral judgment development in these cross^sectional 

Studies. • \ t • 

The. purpose of the present ^t\Ay was to more adequately explore the 

relationship between formal education and moral judgment development by 

^ using longitudinal data. The major questions were: after high school 

graduation, do subject who go to .college sho^^; greater development in moral 

Judgment than subjects who do not go to cblle^^e? To what influences do 

.subjects themselves attribute their 'ow^ cha^i^e in moral judgment? ^ ^ ' 

Method 

59-subj^ts in an ongoing longitudinal stud/ have been tested since 

1972 at two year intervals. The available data for this report are three 

testing: as senior^' in high school, two years after graduation, and four 

years after high school graduation. '38 subjects had gone on to college and 

18 had not. Differences in the course of development of these two £,roups 
\ * 

ax:e the major interest of the study. Subjects' have completed each time a 

questionnaire package including the DIT, Comprehension of Moral Concepts, 

" and a political attitudes test ("iaw and order" test). Also, subjects 

completed a short "life history" questionnaire, and were asked 'to describe 
• I*' . 

what experiences or influences had affected their moral thinking (see ReSt, 
1979 for details^. ' ' " • ' . 

The DIT is a multiple-choice test of moral judgment development derived 

X 

from Kohlberg's approach. Subject?" 'ftite and rank stage-prototypic items 
according to their perceived importance in making a decision about a hypo- 
thetical moral dilemma. Developmental indices are based on the way subject^ 
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differentially rate and rank, the items. The major indices are the P score 
(rolati've importance ^iven to '^Principal Moral** items, Stages 5 and 6), and 

■ • ■ ■ / 

the D score (a composite score based on scaled values of items). 

Results and Discussions * \ 

Both the P scores and D scores showed similar patterns of development 
distinguishing the college from the noncollege groups. In high school 
(wtien all subjects bad the same. level of formal education) the college-bound 
group was not significantly, different from the, non-college-bound group. Then ^ 
two years after high school graduation, both groups had gained significantly 
*on moral* judgment and were still not signif ic^iy^ly different from each other, 
but by the timfe that fg>ur years had passed after high school, the two groups 
wer^ signif icajitly different and were showing divergent patterns of develop- 
ment. Figures 1 and 2 show the patterns of change for the P arid D scores 
oyer tiiue. Tables 5 and, 6 shpw the averages for each gyoup at each testing, 
simple t_-tests at each testing between the. college anu nonccSLlege groups, 
ana ANACOVA results which contrast ^e' college and irbncoilege groups after 



controlling for the pretest scores (scores obtained in high school). ' 

The college subjects also showed a divergent patterVof development 
from the noncollege su'bjects on political attitudes, but not on the Compre- 
hensi9a test. (Problems in reliabi-lity on the Cdtn^rehension test may^ account 
for its nonsignificant differences ^etween the groups,* although Comprehension, 
scores did significantly increase fpr both groups over the four years.) 



ERLC 



* From the "life History" data, it was seen that some subjects were still 
living with their parents (ri = 24) whereas others were not (n = 34). Comparison 
of the developmental patterns of. these two groups showed that those subjects 
living away from home started out with -a developmental advantage, maintained 
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Table 5 

Comparison on P score of ' College *and Non-College Groups 



Means 



Means 
To 



Means 



Co^ge (n = .38) 
Non'^College (n = 18) 

tests ^ 
Coll. V. Non-Coil, 

ANACOVA 

Coll'. V. Non-Coll. 



(partialliug out 



34.8 
19.3 

t = 1.43 ■ 
2.= ' '16 ■ 



44.4 
38.9 

. t. = 1.67 
P. = -10 

F = .90 



4.8.5 
35.1 

t_ = 3^.'37 
p = .002 

F = 9.2 
£ = 004 



scores) 



28 



26 



24 



(U 

' u 
8 22 t 
I 



20 
18 





College 




Non-College 



Figure 2. Comparison on D-§core of College and Non-Lollege\ Groups 

'27 ' 
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Table 6 

Comparison on D Score of College and Non-College Groups 



College (n = 38) 
Non-College (n = 18) 



Means 
T,. 



19.8 
18.6 



fTeans 
To 



24.3 



22,9. 



Means 
T, 



26.3 
2l'.3 



^-tests 

Coll. V. Non-Coll. 
ANACOVA 

c 

Coll/ V. Non-Coll. 
(partialling out 



scores) 



t = .83' 
£ = .41 



t = .76 

£ = -45 

F = .26 

£ = .62 



= 2.35 

£ = .02 

F = 9.95 

£ = .001 



that advantage over the subsequent fdur years,- and increased more than those 
subjects living^ at home. •Analysis of the interaction of being in college 
(or not) and living ajt home (or not) sliowed that each condition* had major effects 
and they were additive (the greatest -development showing up in college students not 
living at home, tne least in noncollege subjects li>^jp^ at home, with the other 
two combinations in between). (See Tables 7 and fi) 

College-bound subjects were subdivided according to the type of 
institution attended: either a large research orienteq university (n = 17) or . 
a sfnall, four-year college (n = 21). No difference in developmental pa^iterns 
was-f^undj.' 
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Table.?. ^ 

* % 

Comparison on P Score of Subjects Living at Home ' 
Versus Those Not Living at Home 



Time 1 



Time 2 



Time 3 



Living at Home (rv = 24) 31.9 



Not Living at Home n, 34 * 34.3 



38.5 
* 

45.4 



39.8 
48.5 



Table 8 

Comparison , on P Score of Subjects Divided" Into 
Place of Residence and Education 



Group 



In College, Living at Home (n = 14) 
In Collpge, Not at Home (n= 24) 



Time 1 



31.3 
37.0 



Time 2 



39.5 
46'. 2 



Time 3 



45.6 
- 49.7 



Not in College, dt Home (n = 10) 
Ntot in -College, ^ot at Home (n = 8) 



30.7 



27.5 



38.8 
39:0 



34.4 
36.1 



Subjects were a^ked to aescribe the influences on their moral thinking. 
What is it that subjects perceive in their environments and experiences tnat 
seems to^them^to cause cliange? The responses were classified into 18 
categories, including reading, formal instruction, current events, new social 
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t 

i 

contacts, marriage or job responsibilitxes making decisions "on my own," 
living away froia parents, religious experiences or instruction, direct 
involvement in political or community affairs, personal tragedy, travel, etc. 
'(See Table 9). - The most f reque*n tly mentioried influence was "new social 
contacts'' (n = 28), however the developmental progress of these subjects 
actually lagged behind the subjects not mentioning this influence but mention- 
ing other influences. 22 subjects attributed influence to "new real worla 
responsibilities" (marriage, job, managing mon^y, children), however the 
development of this group did' not end up greater than subjects not mentioning 
this influence. Fewer subjects cited the mfluence of each of the otner 
factors, but mentioning some of these other factors was associated with more 
dramatic growth patterns: subjects who attributed changes TiiTT^l^lr thinking 
to spanding more time contemplating moral' issues did in fact show more 
dram^^ic development than subjects not citing this factor. Similarly, more 

# dramatic growth patterns were associated wi.th subjectsr citing direct involve- 
ment in community/political iffairs, living away from parents, and travel in ♦ 

^ contrast to subjects not citing those influences. )• 

In summary, this study supports the notion that higher ^ducation fosters 
development in moral judgment, particularly at Jhe four year i^rk rather tnan 
in the first two years of undergraduate educatipn. In addition to this project 
six otlier longitudinal studies of moral judgment using the DIT have been 
cdiapleted on college subjects and all report significant upward trends (al- 
though these studies do not contrast the college students to noncollefe,e 
students): Broadhurst (1980); Kaseman (1980); Mentkowski (in press); Sheehan, 
Hustad, and Candee (1981), Wliiteley (in press). 'The vexing problem remains 'in 
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clarifying how higher education has its effects. It may very weM be 
the case that different aspects of the experience have different impact 
and salience for different subjects." Such a point of vieV is common sensical, 
however our presejit research strategies are designed differently: \to find 
common effects in groups of oubj'ects from the same causes. Progress in 
this research is likely to, come.^ from developing a research methodology 
which enables us to reliably ciraw inferences from the intensive, idiographic 
examination of individual subjects, and which collects data that are not 
^ so indirect and not' so filtered through the subject's ov/n retrospective 
theories about what affected hitn or her. 
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• ^ » Table 9 

Comparison on P Scores of Subjects Who Attribui;e 
' ' Chanj^e to Various Life Experiences 



29 



Typ 


e of Life Experience '* 


Number of 
Citing This 


Subject's 
Influence 


Time 1 


Time 2 


Time 3 


1. 

• 


Reading 


1 J 


YLS 
"NO" 


Group 
Group 


29.2 
34.4 


38.9 
43.5 


41.3 
47.3 


V 2. 


Formal Instruction br 
study 


16 


YES 
NO 


^ 


29.1 
34.9 


41.4 
; 42.8 


44.5 
46.6 


3. - 

c-(- 


--.jCurr^nt issues and 
events ^ * 


ly 


YES 
NO 




,35.1 
32.4 


42.9 
42.3 


46.5 
45.7^ 


4. 


Spending more time con-^- 
templ^ting issues 


8 


YES 
NO 




34.6 
33.1 


48.8 
41.5 . 


53.6 
44.8 


* 5. 


c 

Maturation, "getting older," 
gense of "growit^ up" 


5 


YES 
NU 




24.3 
34.1 


34.0 
43.2 


/ 29.0 
47.6 


O • 


New social contacts , an 
expanding social world 


28 


YES 

xin 
iNU 




31.9 
28.8 


' 41.7 
43.1 


39.4 
51.9 


7 


Specific influential peoplo 


3 


YES 

MO 




•37.8 
33.0 


42.2 
, 42.5 


41.7 
46.2 


8 \. 


'*iicw L cct± wor±a responsi 
bilities — marriage, job, 
'managing money, children 


22 


YES 

INU 




38.3. 
30.3 


38.5 
44.8 


45.5 • 
. 46.3 ■ 


9. 

< 


• 

"Making decisions on my own" 


11 


VT7C 




42.1 
■ 31.3 


45.8 
41.7 


45.5 
■ 46.1 




Making decisions for the \ 
future ^ 


3 


YES 
. NO 




35.0 
33.2 


34.5 
42.9 


40.0 
46.3 


. 11. 


Living away from home 


11 


YES 
NO 




42.0 
. 31.3 


50.0 
40.7 


52.1 
44.6 


12. 


Religious. experiences and/ 
or instr^u^tion 


4 


•^ES 
NO 




16.7 
34.5 


35.0 
43.0 


40.0 
46.4 


13. 


Direct involvjement in com-^ 3 
munity/world political affairs 


YLS 
NO 




31.1 
33.3 


44.5 
42.4 


55.0 
45.5 


14. 


Experiencing or witnessing 
personal tragedy 


5 


YES 
NO 




. 35.3 
33.1 


45.7 
42.2 


39.0 
•46.6 


15. 


Particular time qf personal 
stress as a turning point 


1 


YES 
NO 




23.3 
33.5 


35.0 
42.6, 


46.7 
46.0 


16: 


"Change in lifestyle" 


' 2 


YES 

NO^ 




*38.3, 
33.1 


39.2 
42.6 


47.5 
45.9 ♦ 


V 17. 

i 


Travel 


" 3 

-> 


YES 


1 


31.1 
33.4 


53.9 
41.9 


53.9 . 
45.3 



lis. No cnange in tainking 



6 No change 



31.7 



41.4 ♦ 45.7 
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Studv 11^ 

Nearly every college catalogue names tae development of the capacity to 
form thoughtful judgments about the complex problems of modern society as a 
central mission of hii^her eduisation. Unfortunately, few institutions have 
attempted systematic research to ascertain their success in reachiiig^ this goal. 
Educators have most frequently examined gains in achievement and verbal 
reasoning te^t scores and changes in scores on traits like autonomy, complex- 
ity, social liberalism and interest in intellectualiand cultural activities 
to find evidence of an increased capacity to form thoughtful judgments. 
However, although each of these measureo is clearly related ><ro the Icind of 
intellectual changes to which the catalogues refer, none directly assesses 
tiie 'college student's ability to think about complex issues. For example,'* 
the items on verbal reasoninj^ tests have single, easily verifiable right and 
wrong answers; the, complex problems of modern society do not have ouch 
undeniably compelling solutions. In an era in which the demands upon , 
higher education to account for its outcomes are steadily increasing, the 
need to more clearly document intellectual development during the college 
years becomes .critical. The recent work of King (1977) and Kitchener ^(1977) 
derived from William Perry's (1970") research at Harvard provides a theoretical 
model and an instrument that appears promising in measuring, the impact of 
higher education on intellectual development. The. present study examined 
the relationship betv;een year in college, academic major, academic performance, 
and scores on King and Kitchener's measure of intellectual development. ^ 
In general, although it is preii^ti^e to, make definitive statements about ^ 
th2 long 'range contribution of these Models, the initial results offer 
encQuragement to educators and psychologists alike. 
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Stat^:sin ent of t h e Problem 
Too little -systematic attention has been paid to the elements in the 
educational, environments associate with intellectual development. The 
results of the King' and Kitchener studies for the college' sample demonstrate 
the need to identify those elements. The scores c^f .the college students on 



the Reflective Judgment Inter^/lew were more variable than the •high school 

, ^ / 

or graduate samples and less closely associated with verbal reasoning ability 
than the other groups. Sex differences also approached significance. In 
addition, their scores on the RJI were more similar to the high school 
students than the> graduate students. In an effort to make sense of the scores 
of the college juniors, Kitchener (1977) suggested that the variability over 
the sample could "^be re3.^te^^.^<^'the major fields of the 'Students. She observed 
a trend in her findings for sti^Ments in scientific and technical majors to 
score lower than those with liberal arts majors. Other research on intellec- 
tual development, using a^ifferent instrumetit (Pohl and Pervin, 1968) found 
a signififcant association between major and /cognitive complexity and made 
Kitchener^s hypothesis plausible. It was tae purpocje of this study to 
systematically test the relationship between Reflective Judgment and academic 
major and to explore the relationship betvs^een Reflective Judgment grade 
point average, and satisfaction with choice of major, in order to begin to 
deline'ate the,faetc5rs in the college environment related t;o level of intellecr 
tua! develppment. This study also replicated the findings of Strange (1978) ' 
of a relationship between year in college and score pn the RJ^, and exploreJL 
further the relationship between verbarj reasoning ability and Reflective 
Judgment. * I • s * 
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/ ^ ' Method 

Subjects - . J* ' , ^ . 

The sample in ^is cross -sectional study consisted of 6^ students' 

' . ' • • . * / 

randomly selected from computer listings of Univer^ty of Minnesota students 

enrolled in the fall of 1978, The subjects were equally divided among four . 

groups; freshinen with engineering majors, seniors with engineering majors, 

/ ' ' ^S> ' . ' ' : • * ^ 

freshmen witli-humanities/social sciences majors, seniors with humanities/social 

sciences majors. Each group contained equal numbers of males and females. All 

Students had attended a Minnesota high school and all sseaiiors had declared ^ 

V 

their majors at least three quarters prior to fall, 1978. 



Instruments * 

Three instruments were administered to each subject, the Reflective* 
Judgment Interview, Terman's Concept Mastery test, and a General Information 
Sheet. 53?€la^ffc4;iary S^Jiolastic Aptitude Test scores were obtained from ^ 
admissions dfata. 

Reflective Judgment Interview 

^ . ^ ' ^ , 

Th§*Tleflective Judgment Interview includes four dilemmas presiented . 

. in^'^rS^dom order ^o an individual subject and a series ^of prdbe questions^ 

jthat follow 6ach dilemma. The measure takes approximately ,45 -minutes to , . 

complete ^nd ts administered by a trained interviewer. ^ The format is 

cotisider^d serai-structured since the .interview varies from the standard probe 

questions when necessary to clarify a subject's response. The interview ^is 

taped and a transcription is rated by trained j&dges according tl> the scoring 

rules developed jointly by King and Kitchener. All identifying information is 

edited from the transcript to avpid rater, bias. Each of* the dilemmas 

Involves a controversial issue of general interest. The dilemma presents 



two points of view on the' topic and the probe questions solicit the person' s . 



perspective on the issue and rationale for the concluSion reached". ^ 

\ ' ' - . , J ' 

The four dilemma format was developed by King -and- Kitchener 

aJfter a pilot study of a six di'lemma forma t» Results 'from the pilot were also 

used in establishing the scoring rules, * ^ • ^ ^ ^ 

. Although the instrument is too recently developed to "have accumulated - 

• * . 

* * * 

a large body of reliability ^and' validity evidence, th^ initial result^ are 

supportive in. two ways. Firsts, the coefficients obtained are quite high* . 
Second, the information is entouraging across a range of measures of relia- 
bility and internal consistency. For, the King ^ind SCitchener ^mple, Inter- 
ruter r'eliability , item-total correlations, inter^-irat^r agreement calculated 
in terms of significant difference's' between rater, an4 percent of agreement 
between rate^rs all suggested high correspondence between the ^o judges' 
ratings* /Specifically, the inter-rater reliability .cqefficients ranged frou 
.68 to .94, item total correlations from .90 to .92 a'Ad overall inter-rater 
agreement from .75 to .85. Overall differences Between judges were not*^^ 
significantL They also used internal consistency l,n subjects' scores across 
dilemmas as an indicator of construct validity, arguing that liigh correlations 
between scores on the four dilemmas for each ^subjecft would support their claim 
for validity of the theory. Foj? the total group, correlations ranged between 
.84 and .88^and within groups^ between .56 and .86. All of, tliese correlatipns 
were significant (p <».01). For the. College of Agriculture sampl^e, inter- 
rater reliability wa? .63 (p < .001) with 77-% of^^the ratings falling j«yithin 
the 2/3 point ^iterion level for inter-cater agreement. ' ; 
Concept Mastery Test 

■ • • ■• 

The Concept Mastery Test, first developed ty Tprtnan in 1947, a 40 , 




mxnute written test of vocabulary and verbal intelligence. Because high scoiaes 
are'jue:^^adent on a large vocabulary as well as the ability- to reason with 
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vocabulary, it is appropriately referred to as a meas*ure of verbal reasoning.- 
Tiie test is divided intp two sections: synonyms-antonyms and analogies* The 
test manual (1973) suggests tfiat it is suitable for use. with college students, 
graduate students, and gifted fiigh school students • Terman reports correla- 
^ tions of between -SS and .69 with otjier measures of verbal abilities, and. 
somewhat lesser correlations with I.Q. and numerical abilities measures*. 
Kitchener (1977) reported a non-significant correlation of .23 with the 

' ' * . ' • 

Reflective Judgment Interview for her liberal arts college junior sample, 

but much higher correlations for the high school (.63) and graduate student 

(."78) samples. The test is designed for either group or individual adminis- 

tration; in this study, the^est was individually administered. The CMT in 

4 * \ 

particular was selected because of its appropriateness for a college population 

* likely to have high levels of verbal reasoning ability and also because us^ng 

^ the same instrument as Kitchenfer (1978) allowed for easier comparability of 

findings. 

, General Information Sheet 

The General Information Sheet was used to obtain demographic information, 

academic achievement information, and data on choice of major field. The 

instrunii/nt contains -three pages. The first page asks for name, address, 

\ 

* and telephone number. Thfe second p^e includes items asking for date o^f 
birth, residence, college", major*, year in school, and parents' education 
and occupations, base'd on Hollingshead's (1965) two factor index. of social 
position. Subjects were requested to place ^^n "X" in the blank that best 
describes their parents' education and occupations at the time they entered 
college. The final page contains items related to questions relating to 
grade point average and choice of major field. All subjects were asked to 
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describe in a few sentences their rationale for their choice of maior or 
leyel of satisfaction with their choice of major. The questionnaire took 
approximately t^n -minutes to complete. 

> • i 

Procedure 

Testing was conducted in one two-hour session for each subject. Each 

* ses^sio^began with 3. reading and signing of the informed consent in which 

the nature of. the research was, briefly 'described. Half of the subjects 

received the Concept Mastery Test first, half the Reflective Judgment Interview 

first, and all completed the General- Information Sheet ^as the final task. The 

Reflective Judgment dilemmas x^^ere pres^nte^ in random order. 

X All testing took place in a soundproof room at the University of Minnesota, 

equipped with a desk, two chairs, a cassette tape recorder and tapes, and the 
\ 

testing materials. A separate cassette tape was used for each dilemma. Each 
tape was identified by dilemma number and by the subject^s code number which 
was known only by the investigator. The data collection was completed %ver 
a six wee^ period between November 1, 1978 ^and 'December 10,^1978. 

All; individuals were instructed that the CMT was a -general test of verbal 
reasoning and the RJI, ^ measure of how they. think about issues of general 
concern. 

Data' Analysis . 

Both Analysis of variance and covariance were used to analyze the dat^. 

The independent variables were ma Jo r^ field and year in college. Concept 

^Mastery, Te:^*.. score and Preliminary Scholastic Aptitute Test score were the . 

* 

covari^tes, and Reflective .Judgment Interview score the dependent variable. 
Both an analysis of variance and covariance were chosen because in the 
Kitchener (1977) sti^y CMT score was shown to be significantly related to RJI 
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score. Therefore, without controlling for verbal reasoning ability, any* 
significant results could be interpreted as the result of differences in ^ 
verbal rea^oni^g as much as Reflective Judgment* Similarly, j^^ce some earlie 

reseaifch reported a moderate relationship between intellectual abi^lity-and 

^ ^ i ' 

measures of ego, moral, and 'cognitive development (Loevlnger & Wessler, 1970; 

* *f- * 

Kohlberg, 1969; Rest, 1976; Schroder, DriVer, ^-;Struef art, 1967) and since 
r 

^Kitchener also folind a significant association between intellectual ability" 
and RJI scord, PSAT served as a second coyariate in this study. Pearson 
plroduct moment cjDrrelations were used to te'st the relationships between 
GTA* in major, satisfaction wit^^schoice of major, and Reflective Judgment level 
Additionally, since sex diffejrences on overall RJI score reached • , 

- ' • ' ; 

significance for Strange (J97&) and approached significance (p < .07) for'' 

* • 

the Kitchener sample, a post-hoc analysis of sex differences on RJI scores 
was, clone. The possibility that the sex differences il^y be better explained 
through reference to academic major (Kitchener, 1977) and the lack of 
similar findings in the Perry research were tae rationale for the decision 
in favor of a pQSt-tioc analysis rather than an hypothesis test. 
Resiiits , « ' s $ ' . 

Three independent judges were involved in the scoring of the RJI. One 
judge rated jall*64 interviews (256 dilemmas) and the other two each rated 
half ( IZS'^di lemmas ) . Bef'ore the transcripts wete sent to the raters, tiiey 
were read and edited for cues that would be indicative of the subject *s age, , 



educational level or majoi* field. 



The same rating proced*ure tha^ was used" in prior studies'^was employed 
here. Each dilemma was assigned three scores. As 'explained by King in 
reference to her study, ^ 



Three scores were used to give the most accurate representation 
" possible to characterize the ReflectlV^ Judgment position ^ 

which -the subject discusses each dilemma, The triple ^core - 

h^ps identify and. describe 'the variance across'' positions ' w 
^ and allbws a rater to make a more complex assessment ^bf a 

subject's reasoning style, (p. 121) 
If the ^average of the three scores assigned to any dilemma by the judges 
differed by mo^e than one point, the judge's were asked to re-rate those 

a 

dilemmas; Forty-four of the 256 dilemmas required 'a second ratirjg/ "^If, after 
a second independent rating, the^jdijecrepdbcf was^t resolved, those judges 
d-i^Ji^gd that dilemma and ca^me to an agreement. Two dilemmas required this 
seconcT^e-rating. ^ — ^ , p - ' " 

Reliability of the Refjecrfcive Ju d gment Interview '(RJl ) 
The overall reliability coefficient between Judge 1 and Judge 2 'was^84 
and betyeen Judge 1 and Judge 3, .89. Since judges 2 and^'S rated no common 
protocols,'n:heir inter-rater reliability could not be complited. int;.er-dilemma 
reliability coefficients ranged from .1^ to .387--A'ne kiter-rate'r^eliaUility* 
coefficients are comparable to those reported in earlier studies but the 
inter-dilemma correlations are lower than" those obtained by Kitchener (1977), 
w|iX?se coefficients raiiged .from .56 to .86 for the college sample, and also 
somewhat lower thaYi those reported by Strange (1978), .38 to ,63^ This 
difference may be parti^ly explained by 1:he smaller range in ^corgs over* the ' 
total sample in this study, since a redffced range in'^cores .Stresses the 
correlations obtained. Tliese "lower inter-dilemma' correlations may also be 
the result of the uneven nature of intellectual development among college • 
students,* or may be a consequence of a weakness in interviewer training^^,. 

r 
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interviewer bias, or rating skill. Dilemma- total correlations, in which a 
judge's mean score for a dilepria was correlated with' the subject's total 
score, were moderate, ranging from ,35 to .52. ^ 

Inter-rater agreement wasr*xalculated in two ways. First, simple percent 

/ « 
of agreement between, raters- (in their original ratings) was computed, with 

agreement defined as one point ^r lees discrepancy between the averages of 

the judges' ratings for each dilemma. Then, using^ the procedure recommended 

by Lawlis and Lu (1972), these coefficients were corrected for chance agreement. 

Both sets of coefficients are presented in Table 10. Wlien correcte^for chance / 

agreement, tne percent of agreement is bes,t described as moderately high. In 

sum, ^ these -data indicate that the RJI reliable assessed subjects responses.* 

' Table 10 

' a ' 

Reflective Judgment Interview Inter-Rater Agreement Coefficients 

for Total Sample:^ Unadjusted and Adjusted for Change 

r ' " ' Agreeraent 











Dilemma 


Unadjusted 




Adjusted 


1 (Egyptian Pyramids) . 


.«13. 




• 

.762 


2\ (News Reporting) . 


.7^2 




. .753 


^ 3 (Creation/Evolution) * 


.844 




.711 


4 (Chemicals in Foods) 


. 7.67 . 




.692 


r 

Overall.-' 


.,.802 




.728 


Agreemei\t defined as one point 


> V — 

or less discrepancy. 






_ — ^ 






' J 






1 
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The d^s^ibutlon of mean RJI scores is presetited in Table* 11. The 
range of mean scores for the total sample is fron 3-13 to 5.08, with the 
grand mean at 3.81. The scores of the majority of freshmen fall into the 
dualis tic. category while the majority of seniors '§core at the relativistic 
level. The freshmen in humanities and social science^ majors had the lowest 
mean score (3.52) while the seniors in humanities and social sciences l^d the 
highest mean score (4.05). In general, taese scores are compai^blfe to those 
reported in the other research on Reflective Judgment. Kitchener (1977) 
obtained a mean of 3.6^ for her sample of 20 college juniors in liberal arts 
and King and Parker (1978) reported a mean of 3.93 for their sample of 20 
juniors in agriculture. The range of scores here is slightly smaller than 
the range repotted by Strange (1978) in his sample of traditional age freshmen 
and seniors at the University of Iowa, 3.28 to 5.56. 

Group Differences in Reflective Judgment Interview Scores 
One major purpose of this study was to examine the relationship between 
the level of intellectual development of individuals in college, and their 
year In^college and academic major. Prior research (Strange, 1978) ha^l 
indicated significant differences between fresVimen and seniors and had pointed 
to a possible relationship between academic major and level of development 
(Kitchener, 1977). In this section, the results most relevant to those issues 
will be discussed. Hypothesis I dealt with the differences betweerx freshmen 
groups in TUI score. A significant relationship between RJI score and major 
for these first quarter freshmen would suggest an association between Reflective 
Judgment level and initiai^ choice of major. An analysis of variance indicated 
no significant differences between the,^ two freshmen groups on the RJI (Table 12). 
No evidence of influence of Reflective Judgment level on choice of major at 
entrance- to college h^s been revealed in this study. 



Table H 

Distribution of Mean Reflective Judgment Interview Scores 
Over All Dilemmas for the FoCir Student Groups 
(by percent) 



Student Groups 



Mean Reflective 
Judgment' Scores 



Humanities/ 
Social- 
Science 
Freshmen 



Engineering 
Freshmen 



Humanities/ 
Social 
Science 
Seniors 



Engineering 
Seniors 



Dualism 



1.5 
2.0 
2.5 

3.-0 

a.'5 



44 

38 



6 
56 



6 
44 



. ~ 4.0 
4.5 

Relativism 5.0 
5.5 



19 



38 



31 
25 
13 



25 
13 
13 



6.0 

Probabilism 6.5 
. 7.0 



/ 



100% 
N = ,16 
X = 3.52 
S.D. = .329 
Range = 3.15-4.17 



100% 
N = 16 
X = 3.72 ' 
.317 
3.21-4.50 



100% 
N = 16 
X,= 4.05 
.^78 
3.25-5.04 



Note: Total3 may* not equal 100 due to r'ounutng.. 



X ■■ 



100% 
= 16 
= 3.94 ■ 
.557 
.17-5.08 
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•Table 1'2 ; . - * 

Analysis of Variance on Reflective Judgment Interview' Scorers 
for Vreshmen by Group. and Sex CN - 32) 



Source of Variation 


' > df 


" ms 


F 


P 


Group 




J .313 


2.853 


^102 ' 


Sex 




" .014 


.126 


.725 


Group X Sex 




.049 


.445 


.510 


Residual 




.110 






Total 


• 31 









Hypothesis II focused on the difference between the seniors in engineering 
and tlfe seniors in humanities and social sciet^ces. Any significant difference 
beJtiyeen the two groups on RJI score would suggest that academic pa j or is 
related to the level of intellectual attainment. Tiie results of a one-way 
analysis of variance presented in Table 13 show no significant differences 
between these two groups. Although the mean score of r^eniors iu humanities/ 

social sciences is higher than their counterparts in* engineering, the 

* ' . - f- 

difference is not significant. Nothing in these findings supports the inter- 
pretation that the academic majors produce different levels of intellectual 

development as measured by the. RJI. 

m , ^ 

The^ findings for Hypothesis III, howeverj lead to rejection of^the null 
hypothesis,. Wlien the scores of freshmen and seniors were compared, a 
statistically significant difference resulted. .'A three-way. analysis of variance 
witl} year in college', major, and sex as the independent variables and RJI score 
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Table 13 

Analysis of Variance on Reflective Judgment Interview Scores 
-^.^ for Seniors by Group and Sex (N = 32) * 



Source of Variation 


• df 


ms 


' F 


P 


Groijp 


■1 - 


.096 


.294 


.592' 




1 


.521 


1.598 


.217 


Group X Sex 


1 


.018 ~ 


*'.054 


' .818 


Residual . i 
> 


28 


..326 







Total 


- ' 31 







as the dependent variable revealed a significant main effect for year in college 
at the p "^.Ol leyel, but no significant interaction effects (Table 14). In 
othfer words, the differences between freshmen and seniors in humanities/social 
sciences §ire not significantly greater than the dif f eri'i^ces between freshmen 
and seniors- in engineering. The outcome of this analysis supports the 
findings of J t range 0^978) 'that a samp]^e of older, more educated students score 
higher on the RJI thaa younger and less educated students* 

^ Effects of Controlling for Verbal and Intellectual Skills 
, Since both PSAT and CMT were significantly associated with Reflective 

judgment level in Kitchener (1977) and ACT composite score correlated 

I* I • 

significantly with Reflective Jtidgment in Strange (1978), the relationships 

between RJI, PSAT, and CMT were tested in this study. For this sample no 
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Table 14 ■ 

J 

* Analysis of ^riance^on Mean Reflective Judgment Interview Scores 
by Year in College, Majoy, and Sex 











4 


Source of Variation 


d£ 


. ms 
• 


., F 


P 


Year in College 


1 


2.250 


10. ,324 


.002 


ilajor 


1 


.031 


.144 


.706 


Sex 


, 1 


.353 


1.618 


.209 


Year in. College x Major 


1 


.378 


1.733 


.193 


xear iir cSllege x Sex 


- 1 


.182 


.837 


.364 


Major X Sex 


. 1 


.004 


. .018 


.894 


Year in College x Major 
X Sex ^ 




• 






1 ^ 


.062 


.287 


.594 


Residual ^ *% 


56, 








Total 


63 









f 



Significant correlations between RJI> G-lT, and PSAT were found with the 
exception of the correlation between the -two ability measures, the PSAT and 
CMT. When these results are compared with those obtained by Kitchener for 
the college sample only, they appear less discrepant. In her research the 
correlation between RJI and CMT was .23 and between RJI and PSAT, .30. 
Neitiier correlation reached statistical significance. Both the correlations 
obtained ia this study and the results of the analysis of covariance suggest 
that the Reflective Judgment Interview is measuring a construct di'Btinct from 
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verbal reasoning ability* The differences between groups remained significant 
after CMT and PSAT are covaried out* Tliese findings support Kitcnener's 
interpretation that Reflective Judgment and verbal reasoning skills develop 
at different rates during tfie college years. * 

The mean score of the four groups on tae CMT were as follows: engineering 
freshmen, 50.2; engineering^ seniors., 55.6; humanities/social sciences • 
freshmen, 54.5; and humanities/social science^ seniors, 64. l.-* Wo significant 
differences on the CAT overall were obtained, but when the scores on each 
half of the CMT were analyzed separately by a one way analysis of variance, 
differences between engineering and humanities/social sciences majors were 
revealed. The students in liberal arts majors scored si-gn^Lcantly higher 



I synonyms-antonyms sectl 



o.i the synonyms-antonyms section (p < .05) than the engineering students^ 

a section of the test that Tjatnnan asserts is a measure of vocabulary ' » 

^ 1 • * 'V 

predominantly. Tnis difference is congruent with the increased emphasis In 

liberal arts on reading and writing skills. No significant differences 
.between groups on PSAT scores were found 'even though the mean score of those 
in engineering wafe slightly higher (51.6) than the mean of those in 
.^umani ties /social sciences (50.4). / ' « 

Discussion of the Results 
^10 m/iin effort for year in college supports the findings of other RJI 
researchers and more generally supports the trend in the literature on 
college* student development which demonstrates atv^mpact of' college on those 
who attend and persist beyond what could be expected by maturation alone. 
However, the range in scores and the highest scores are smaller and lower than 
Vhat would' be predicted from prior research on RJI "and considerably smaller 
than the range In the original Perry sample. 
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■ ■■ • ^ ' ' 

A recently published ^tudy by Astin (1978) appears useful in making sense 

bf the small range in scores. Astin' s work also seems helpful in interpreting 

the relationship 'between Reflective Judgment, year in college, and' academic 

major. Astiii and his colleagues studied 200,000 individuals longitudinally 

between 1961 and 1974, bota non-students and students vLn a variety of aigher 

educational institutions. He a4:tempt^d to ascertain the relative ^ippact of 

Ciiaracteristics, and the amount and type of involvement in college life was 

measured vsing type of residence (dormitory, apartmen):, or at-home with 

parents), participation in special academid programs and research activitiies, 

faculty-student interaction, participation in social and athletic activities 

and sororities and fraternities, and academic involvement (Clme\ studying) as 

cri/teria for involvement. He reported that the size pf the- institution wa^ 

correlated with , its impact on students. Large public universities with a - 

high ratio of cbmmuters and fewer opportunities for involvemejut in special 

programs or campus activities, or for faculty-student intreractioiji slfowed less 
I ' " ' ^ . 

change on both cognitive and affective dimensional The University of Minnesot 

is typical of' the large uni'frersities tie studied. Therefore, it is reasonable 

to suggest th^l the nature of the institution frpm which the subject^ in this 

study were sami>ledlvmay have depressed the scores on the RJI, and by depressing 

'the scores o^f the seniors, reduced the range^ of scores in the total sample. 

Furthermqre, when Astin analyzed~the inf-luence-of major field he 

1 • " ' " 

found those in engineering showed s^'fnaller than average changes and those 
in social sciences, greater than average changes. Engineering studenfe, he • 
reported, spept proportionally mo4;e time studyin^^, had more stringent grading 
requirements, and .yere frequently isolated from students in a separate 
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technological school, a conse4uence of the difficulty of tlie academic 

program and the si^paratlon, engineering students were less Involved In college 

life and In turn, showed less change. The ^Jmall diffei:ences between RJI scares 

of the two engineering grfJups, less than one quarter position, is consistent 

with Astin^s findini^§. Since no data. are available on engineering majors from 

a smaller college, no conclusions can be readied concerning the degree of ; 

/ : \' * ^ ^ 

' contribution of the instructional factor and the ^najchc: field. 

Astin's^ study also offers a pSssible explanation^ for the lacTc of 

significant •differences between the two groups of freshmen. According "to 

Astin, and to Feldman and Jewcomb (1970), those who encer public institutions 

Share more common demographic aid abi]i^ characteristics than those who 

.enter private colleges. Therefore, It may be that students match themselves 



to a type of 'institution rather than to a^major field within tKat institution 
Uesearch inducing demographic data, ability data, and RJI adores on freshmen 
entering a^var^iety o'f types of institutions would be useful in exploring, thi 



relationship.' 

\ 



s 



In a more general way, Astlgi*s findings, coupled'with the prior research* 
^ on'^college student development and the results o^ this study, argue for 
research designs that go beyond the simple distinctions of sex, major, and 
year in college and take into^^ account' more carefully both the characteristics 
of the institutions apd the dfegi:ee of involvement in college~„lif e. The 
11 terature^jpih,.^34''eg6!]^6tudetit development clearly implies^that pajer contact 
is most strongly associated with the development; it is imperativ^ that ^ 
future research into Reflective Judgment*^take into account peer contact 
' variables. ResearchersHnto the Perry scheme (Widick, Knefelkamp, & Parker, 
1975; WidiQk & 'Simpsonj 1978; Mason, 1978; ToucHton et 'al., l'J78) have 
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consistently reported significant increases in Perry position when courses " 
. are designed with the stimulation of intellectual development as a "primary 
purpose. Studies of the influences of spebific c^^issroom experiencas and 
modes of instruefion on RJI scores ought to be conducted. It is posoible 
that the differences in ^pact between lar^e and small institutions may be 
a function, of more personalized instruction as weU^ as increased" -involvement 
in the campus life and peer contact. * ' 

In short, while any conclusions based on these results are subject; to 
the reservations cited above, the data are consist^it with the interpretation 
that older students^ho persist in higher edutatioj; show greater .capacity ' . . 
to mal;e reasoned judgments about intellectual probT^ems than their younger, 
less educated counterparts, 4^gardle£(s of major 'field of study. 

Nevertheless, e'ven though ^tbe scores of senioijs . differed significantly 
rrom those of the freshmen on the Reflective Judgment Interview, seniors in 
this sample wer^ s^till using w^im as often as tevidence 3iid logic^and could ' , 
not see. any way^^ c^nsij^jfegtlx evaluate points of^^view as better or worse ^ 
aside Ifrom indilwiu^ijtai lA .o't;Jjec wotds, t^eise seniors were' 

only somewhat .better equiwp^d than -thfe^ff-eShmeft to^cop^^ with ..the complek : 
problems of modern s*ociety?and were ^cef tai^ly, mucb .^e^s devjl^loped intellectually 



than those responsible for their education'^woHld^^ge.'.-;.^;^- 

Furthermore, despite the common viw thati^^lege students in technical 



fields tend to be more dogmatic in their tli^king^^'hd^signif i'^cant differences 
between "those. in engineering majors and/Ehose in humanitils/social science . ^ 
majors were found in this study. The size of the ^ifferahde in RJI scores between 
freshmen and seniors iipif(imani ties/social ^science was' Approximately the sam^^, - 
as the difference between freshmen and s-eniors if* engineering. ^ 
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In sununiry, freshmen and seniors differed significantly onir their 

I 

Reflective Jijidgment Interview scores, but the difference in reasbnl^ between 
freshmen and seniors in social science/humanities majors i^as approximately the' 
"same size as the difference between freslimen and seniors in engineering majors. 
While any conclusions based on these results must be subject to the 



reservations cited sbove, never thless, the data are consistent with the* / 
.following ideas. Older students completing higher education exhibit a greater 
a^^eness of multijple perspectives on the complex issued posed in the 
Reflective Judgment Interview. Despi^ the common conception that technical 
students tend to/be more dofe,matic, the engineering students in the present 
study did not differ from the social science/humanities students in the , ^ 
coniplexity-4izjr€h which tiiey viewed the issues. While the seniors in the 
sample seemed -more a^dvanced than the freshmen in their capacity to make 
judgments about complex intellectual subjects, they appeared^' less developed 



intellectu^ally than those responsible for taeir education would hope* Seniors 
used whim as often as evic^ence and logic in deriving their views, and they 

■ / 

still could not see any way to consistently evaluate points of view aside 
\ from individuaL idipsyncracies*- ' V 

' ^ j * Study III - • 

The* primary goal^of this study is to assess the impact of graduate 

education on cognitive and cognitive^-social developmental measures* To 

J successfully address fhis question we must use a procedure which isolate 

not only the effects associated with education but alsQ those effects ^ 

^ associated with competing^explanationS for group differences^ Two common 

i alternative explanations for observed gro\4yir are ra^turatlx^n land selection* 

Our procedure specifies a priori patterns of possible results which best 
* • 
argue for one explanation over the other competing .views.' Tuese ^patterns 

O are then compared with the observed pattfern to determine the best match. 
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' Waen used with pur population and purposes, this procedure specifics 

-at ndnimuta four groups of ^subjects. Two groups of graduate students at 

, different stages .in their training, and two groups of college graduates 

similar to the graduate groups on age, sex and verbal -ability. 

These four groups caeci be thought of as cells in & two by two matrix, 

the rows corresponding to enrollment- status, and the columns to age. The 

patterns for the three competing effects, education, maturation and 

^ • » * . * 

selection follow directly froiji this matrix (see Figure 3). If maturation 

a 'factor the row means should be signif icarrtly different (F^ure 3a)- If 

selection is a f a^ctor, the column means will differ significantly (Figure 3b) 

If education is a factor thei^ interaction between .the column and rows 

should occur <Figure 3c). Further, £his* interaction should be due to a 

^lean difference, between the enrolled groups that is greater than the 

corresponding differences iji the non-student groups.- ^ 

The pattern we expect ta see in the, data will include a combirnation of 

the t^^ee pure forms shown in Figur^3. Although all these pure forms may Jb 

found in ^th'e data, the crucial test of the effects associated with education 

remains the row by colUmn interaction described above. 



• ^2 



Dependent 
Variable 



I?- 



Dependent 
^^^^Variable 




Enrolled cell means 

V 

Not enrolled cell mestns 



^ Younger ' Older 

Figure 3a, Maturatiofn Effect 



Younger ^ 
Figure 3b. Selection Effect 



Enrolled cell means 



^ot enrolled cell means 

♦ • ■ ' • 



Older 



Dependent 
Variable 



Enrolled cell means 



Not enrolled cellnneans 



, Younger Older 
Figure 3g. E ducation Effect 

4 • V 

Figure 3. Pure forms of tl^-A priori' patterns. ^ 
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' * Method , ' . 

/• / * ^ 

Subjects 

Tne sample collected for this'study included eighty subjects, twenty 

Hi ' / ' ' 

advanced graduate/students,, twenty first-year graduate students, and 



forty college graduates who had not^tered graduate school^ These groups 

are equally divided by sex.^ All, of the graduate students^were enrolled at 

the University of Minnesota during the academic year 1978-79. 'i;he degree 

programs represented by these subjects were the traditional liberal arts 

majors excluding psychology. • ^ . . * ^ 

* * • ^* 

Advanced graduate standing was defined -as having completed thi written 

r ♦ 

, preliminary exams required by the individual degree programs^ All subjects 
in this group had been enrolled in their/ programs for at least three years. 

The first/year graduate^ subjects were all in their first year of 
graduate scaool; transfer stuHents were not included in this sample* 

The forty non-enrolled subjects had^'never enrolled in a gradyate program^ 
but were of comparable age, and schofastic aptitude ^o the graduate^subjects* 
In addition these subjects , were currently living and working in the .Twin 
Cities metropolitan area. , 

The selection process v/as as follows: a' random sample of names was 
generated from lists of advanced graduate students sYipplied ty the graduate 
school. These 'potential subjects were then contacted by mail or phone. .This 
procedure was repeated until\,both ten males and females agreed to participate 
in the study.* - ,^ , ^ 

First year subjects were selected -in a similar fashion with the one 
exception that each subject Tiad to have ^Scholastic Aptitude Test scores on file 
at the^niversity that roughly matched the scdres obtained from the advanced 
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group ; - 

The non-enrolled group vrjfe recruited f rom *news|)aper advertisements, 
nominations from other subjects, and from lists supplied by the University 
of Minnesota Alumni Office. Of the potential subjects who responded to 
these recruitment procedures only those people who fit the age and test 
scor6 profiles of the graduate group were included. These -standards ha.d 
tQ be .relaxed for one sub cell due to^ our inability to locate 10 male 
college graduates yho fit the profiles of the first year gra'duate males. 

> 

The four males who were finall;^ selected had scores that placed them in 
the upper third of their norm group. The ^t of the sample had scores . 
in the upper twenty-five percent of their norm group. , 

Instruments" ' 

Five instruments, dh^ Reflective Judgment Interviews (RJI), Rest^s^ 
Defining Issues Test (DXT) , Loevinger'6 ^Sentence Com£pLetion Test (6CT) , 
a general information ques.tionnaire and Terman's Concept Mastery Test 
^CMT) were administered to each subject. 

Reflective Judgment Interviews . ' * ^ ■ . T 

The RJI (King, 1979; .kitchener, 1979) is a semi-stluctured interview 
consisting of four dilepnas, the origin Of 'the Egyptian Pyramids, Objecdivity 
of News. Reporting, Creation versus Evolutiony^ and the safety of chemicar 

additiyes in food. The interview is guided %y a standardized series of 

* * • . 

probes designed to elicit the subject*s reaction to these dilemmas and 

his/her ^se of evidence to support their .viewpoint . Each dilemma is defined 

lEor Subjects by presenting two contradictory positions ^within the above - 

content domains. The interview lasts for approximately 45 to 60 minutes. 



The* scoring prociedure for the RJI utilizes trained raters who 
±n(iependently score each response to each dilenuna. The individual dilemmas 
are summarized' by. three ratings which represent a major and two minor stage 
scores; for example a protocol scored 443 would Indicate that the dominaj^ 
sfage for this subject is Stage 4 along wit?h some evidence of Stage 3, These 
four triads, one Set ^or each dilemma, are summed and the' mean response • 
-^-obtained. This figure is used as the-^omposite score for thfe subsequent 
analyses V • . 

The DIT is an* objective measure of moral reasoning development (Rest, 
1979, Note 12). Subjects are* required to^read six stories,, each describiitg % 
a situation with competing, social claims. Subjects are' then asked to^udge 
what he/she would do, in the hypothetical Wtu^ion and' then rate and rank 
12 issues relating, to their decision. The^^majority of, the 12 issues are ' " ^ 
st;age- typed to Kohlberg's (1969) stages of moral development/ The 
remaining issues are designed as validity checks. . . * 

Subjects'* ratings and t^nkings ate summarized by the P and D scores. 
P scores utilize the ranking data and are,def ined^^the weighted sura^of , J 
the ranked principle!^ types issues (Stages 5, 6)1 . Percent P is the, most , ^ 
coipion -index found in the literature. 

'The D score takes into, account the f611 r^ng^ of gating responses and 

■* ♦ * /. » " • 

represents the use of principled thinking! in relation to preconventional 

** . « ' * '\ 

and conventional thinking. ; n 

\ \ .\ 

TheSCT of ego development (Loevinger, et al., 1970; Loevinger, Wessler, & 
Redmore, 1970) has two forms, pne designed for men and the other for women. 
Both fo^ms have 36 items ^* Each » item requires the subject 'to complete i 
sentence stem. % 

To arrive at the composite score/ for a subject; trained raters first rate 



(individually) all 36 items for ego level and then compare the cumulative • 
frequency distribution of item rates to publi^^ed tables of potential valu.es. 
This procedure yields a single rating which is the measure" of ejo developiaent 
used, in the analyses. 

' , ThetMT (Terman, 1973) is an objective test 6f verbal reasoning ability. 

Tnis test was 'designed to discriminate people who' are superior in verbal 
" ' » 

' . <. * 

reasoning and' will therefore be appropriate for. the present group of subjects 

Tire CMT requires the subject to answer 115 synonyms and antonyms ^ plus 95 

dtialogies. This tes't is ^primarily used in 'this study ^to statistically \ 

determine whether any group differences founcf by the primary measures 

\ , . . ' <^ ' ^; * * ^ . ^ 

mentioned above, can be attjibutedv to differences i,n verbal ' reasoning. 

. \ ^ • * . ' \ ' ' 

This final instruifea^ti is included to proyide an estimate of socio- ^ 

economic status (SES) using Hollingsheids (Note 13 ) pr^Jcedure. This- estimate 

^ / ^ - . ' 

will be used to assess the relationship between SES ari^^ the primary measures 

in a maifner similar to that described ^\>;lth tfie 'CMT* 

Procedure ^ . ^ . . ' • 

The length of the Reflective * Judgment interview 'made it necessary to 

have subjects complete ^ome of tjie- measures .without supervision. It was 

therefore determii^ed that the DIT and SCT.^ woald^e sent to each subject along 

with a covering letter coftfirming. the interview. <date. The letteV also 

requested that, fhe tx^o measures be coihpleted before the interview. 

On arrival at the testing* location each subject was informed of the. 

' • * 

experimental 'procedures and a final consent form obtained. The research 
alssistant then proceeded directly v/ith the RJI, Following the interview^the 
^^neral info'rmatiojr questionnaire was completed'. The subject, was then ^ 



escorted* to the CMT testing room and asked to. carefully read the instructions 
in the test booklet and begin the test. No, time limit was enforj^ed for any* 
of the above procedures: , - * * * • 

< ^After the testing, each subject was debi;iefed and th^ measures 
completed at* hpme, collected. Each subject was paid $10 upon completion 
of the instruments. ' > 

R esults , ^ * * 

1 Group Characteristics: TabJ.e 15 shows the obtained group profiles 

for the^four groups. Although the SCT and DIT analyses 'used -fewer' subjects, 

due to rejected protocols, the group profiles do not significmtly deviate 

^roc T thos e^shovn in Table 15. ' ^ • . 

*. 'Reliability of the Reflective Judgment Interview, Interrater reliability 

and agreeihent, was computed on a random 25% of the ^protocols rated by both ^ 

raters* These coefficients wfere'*l75 and .69 xespecti^eiyi, which are comparaMe 

to th^^ results, of other recent! studies (W^lfel, 1979; Kitchener, i979)- A " 

> ' I • , ^ t 

further' indication of. the reliability of ^the measure was th^ internal tonsis- 
' " ' . ^ ^ . ^ ; \ ^ 

tency coefficient.^ Cronbach's alpha for all groups across a^l dilemmas was . 

.79; again thi3 figure is similar to those reported by/ other ' studl^es (Strange, 

1978; Kitchener, 1979; WelfeJ., 19/9). < . ' ^ ^ - ^ 

What fpllows are .the results for 'the primary measures. Inferences cpn- 

cerning- the thre§ hypothesized effects will be similar for each primary measure 

if there is an additive effect selection, .djie vTould exfect the* means for 

the enrolled and noiienroll^d groups to differ 'significantly; if there is. 

^an additive effect of maturation, the mSjln effect for ag^ will be' sj^rSaiTtcant; 

• if edtication is associated with the growth process, then differehees between 

th^ -two graduate groups will be greater than'Lthe differences* between the 

♦ ■ 



Table 15 ' 



Group Characteristics # <^'^: - 
Median verbal standardized tesft percentiles by group 



Younger 



Older 



* 


mdn = 93 




mdn = 95 


♦ 

Enrolled 


range = 77-99 




range = 87-99 




N = 19 




N = 20 




mdn =88 




mdn = 90 


Nonenr oiled 


range =^63--98 


• 


range = 77-99 




!n = 20 




^ N = 20 

> 



Enrolled 



Nonenrolled 



Younger 



Age 



Older 



' X =' 23.85 - 


'X 




30.30 


sd = 1.88 


" ' sd 




4.97 - 


N =' 20- 






20 * ' 


_ X = 25.15 


X 




30.05 


. sd =• 2.48 ' ■ 


sd 




.2.06 - 




'N 






V •' N = 20 




20 • 
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nonenrolled groups. ^ This interaction is of cruciaL importance to the 
hypothesis of this study. 

RJI: Table 16 pre^sents the cell means and standard deviations .for the 
total sample. These cells were pompared using a hierarchical step dovm 
MOVA procedure where the tnain effects jarfe entered first followed by the 
Interaction , effects. When covariates' are added, they are entered- before 
,the main effects. ' ^ , ' 

The result of the RJI analysis shows that the three main effects, sex 
(p < .001), maturatioti (p <'.05), and selection (p < .01) are all* 
significant. All q£:^e ^interact ions, including the crucial interaction 
suggesting tKat/"educa^;ior^^ with^frflective -Judgment , are not- 

significant (p > .05). * . • 

^ ^ When^SES and; currerit5^erbal' abilities* measures <are » added tie tt^e^, 
analyses as covariates, the se'x (p < .01) aAd selection (p* < .01) effects 

:fe 



remain; however the main effect for maturation is- no longer significant 



(p < .20). ^ 

In sum, these results suggest that men scqre higher than^|gmen on 
the RJI and graduate students scored higher than nonstudents; a pattern 
which suggests a selection explanation for the^if f erences between the 
students and nonstudents. 

• SCT: 78 valid protocols out of a possible 80 wer^ rated by a trained 



I 

rater, blind* to conditions. To perfom the following analyses Loevinger 

' w ■ - 

Stages were assigned th*e numerical values listed iti Table 17. Using 

V • . ' ' 

th^se values Table 18 presents the means and standard deviations of 

\' • - ■ ' - , • \ . 

the Tour subgroupsl!^ The ANOVA procedure described above was used to 
^compare these groups. Although the means i\i Table 18 display the 



Table 16 



V 



Cell Means atid Standard Deviations for Reflective Judgment^ 



Scores by Group 



Enrolled 



Younger 

X = 4.60 
sd = .71 

n =**20 



IJonenrolled 



x = 4.02 
sd = .67 
n'= 20 



Older 
X =4.94 
sd = .81 
'n = 20; 



X = 4. 25. 
sd = .51 
n = 20 



•fir 



»• I' , I t ,.1 



Table 17' 



.«9 



Loevinger Stage 

.Numerical 
EquivalAit 



2/D D . D/3 3 3/4. 4 4/5 ' 5 6 
1.5- ,2 2^5 • 3 ^.5 4.5 5 6 
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hypothesized pattern which would suggest an association between education 

^^^^ o * # 

and ego development, all main and interaction effects are nonsignif icant. 
^ , * DIT;. Sixty-seven subjects completed DIT^s which passed both 
validity checks built into the scoring procedure. 

Ta|)les 19 and 20 present summary tables for both 'the P and D indices. 
The above mentioned ANOVA procedure^ was used to compare these cells. The 
main *ef fee ts for age (P score, p < .05; D score p <^.01); and enrollment 
(P score p < .05; D score p < .05) are significant for botht indices. The 
sex effect is significant only with the D scor^ (D score p < .05). The 
crucial interaction, suggesting sfn educational impact on moral reasoning, 
along with all other interactions are not significant. All of the iaain 
^^^^^^^ remain significant when curr.ent verbal ability and SES are entdred 



Jlnto th^ jnalyses as c^variates. * - » " 

, TJrese results suggest that, women score .higher on the' DIT than men ' ® 
when- one considers ' the total distribution of item responses. Most 
importantly, these data ^ow qlder subjects scoring higher than the younger 
subjects and enrolled subjects scoring higher than the nonenrolled subjects; 
findings which correspond to the a priori patterns representing selection 
and' jnaturation. In short, one need not" postulate an additiye effect of 
education to account for the difference found iii Table IS* 
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Table IS 

Comparison of tne U'ormal Ojive Score 
of Enrolled and Nonenrofled Groups 



Yoi^nger Older 

• X = 3.749 ' X =-3.947 



Enrollment effect "F(l, '74) = -.312' WS . 
Age X Enrollment "P.(l,-74), = .441 NS - 



f\ 
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ERIC 



Enrolled = ?646 ' ^ - . su = .405 r 

. N = 19 , y = 19 

** * • 

X = 3.800 X = 3.825 

Npnenrolled sd = .548 '.' ' sd = ^38 

■ • w = 20 . ■ , ' N =• 20 . ■ - 

MOVA' %%& effects F(l,74) « .805 NS 



.61 



0) 
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u 
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Table ■ 19 ' .V,.. 
Comparison on % P Score of Enrolled and Nonenrolled GroupS 



Younaefr 



X = 62.37 
sd = 11.22 
N = 7 



X = 64.59 
sd = 10.38 
N =■ -8 



Total Cell 
X = 63/55 
sd = 10.45 

f 

n'= ' 0 



— r— 

X = 51.48 
Sd =ffl.26 
N = 9 



X = ■52.9.8 

sd = .8.55 

N = 9 
•Total Cell" . 
X = 52.23 

sd = 15.74 . 
N = 18 



sd = 
N = 



• 01d.ei; 

65.18 X 
sd 

9 „ 51 
' Total Cell . <■ 

X = 65.461, 
' sd = 10.84 

.: =118 



65.74 

11.40 

■7 



= 9 



- r 



• X 

sd 
N 



56. S6 
10.86 

8 . 



"x, = 67.88 
sd = 7.78 
N = 8 



Total Cell 
* 5^= 62.37 
sd = 10.75 

N = 16 



V 



AHOVAr Age effects 



Enrollment effect 
Sex effect 



'I F(l,59) 
' F(l,59) 
F(l,59^ 
• F(l,59) 



Age X Enrollment* 
yAll other interactions NS 



4.849 P .05 

5.59 P .05 
1.550 • NS 

1.&7 AS > 
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Table 20 



Comparison on D Score of Enrolled and Nonenrolled Groups 



Younger 



Older 



•0 
01 



o 
u 
c 



sd 
« N 



32.52 
5.25 
7 



X 

sd 
N 



32.49 
7.21 
8 



<U 



O 
U 

a 

0) 

c 

. o 



Total Cell 
X = 32.51 
sd = 6.15 
A = 15.0 



x.= 24.90 
sd = 6.18 
N = 9 



X = 30.11 



sd = 4.55 



Tottl Cell 
X ^ 27.61 
sd = 5.9^ 

,N =■ 18 

ANOVA: , Age effects: 

Enrollment effects; 
. Sex effect: 

Age by, enrollment 



!S = 33.26 
sd"= 6.81 
N = 9 N 
Total Cell 
, X = 34.83 
^ sd = v6.33 
W='18 



, . X = 36.74 
sd = 11.40 



X = 29.91 H ' X =-35.55* 

■ " ■ / 

sd = 5.56 * sd =/ 6.94 

N = 8 = 8- 

Total Cell 




All other •interactions NS 
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Dls:Semluation / ' 

Our at;,tgmpts to disseminate the results of thi^ project have taken three 
former journal articles or 6ooks, tecnnical reports, and addresses to 

• . . ' 

various forums by the members of the project staff • ' 

Addresses , - * ■ 

One of the first addresses based on tHis project was in fact a "series 

t of three addresses given to the Association of College Unions . ».Inter national 

in Minneapolis, Minnesota, March, 1980. Jaiaes .R. Rest delivered "^a paper 

entitled Moral judgment developinent in liigher education , Mark L. Davison 

delivered a paper entitled How students tackle the tough questions ,, and 
* ^ 

Jane Lawson delivereu a paper en.titled Rearranging the living room > 

In October of 1979, James R. Rest addressed the Menninger Foundation 
^widi a talk entitled The fliipact of higher education on mor^l judgment . Ste~ 
phen Thoma and Mark Davison prepared a pdper entitled GraHuate education 
and moral Judgment development for the Iowa Educational {Research and 
Evaluation convent^ion, Iowa. City, Iowa, December 4-5,^ 1980. 'And, finally ^ 
James R. Rest 'recently laade several presentations to the American Educatfbna'l 
ilesearch Association and the Society f5r Research in Child Development Vhich 
weire wholly or partly ^ased on the research in this project'; The impact 
of higher education on. moral judgment development ; Moral dilemmas of young 
aclults ; The major psychological components of morality ; and Action advocacy 
in. hypothetical moral dilemmas . ^ ^ ' ' 

Tectinical Reports . , ^ 

Eight technical reports have been prepared in this project. The first. 
The Impuct of higher education on moral judgment development by James R; Rest 

■ ■ ■ .1 
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^0 ^ 



add^'ess to the Menninger Foundation mentioned above, 
ark L. Davison, Patricia King, Karen Kitchener, 



is an extension of his 
The second report^ ^b/f^h 
^ ij^i^and Clyde A. Parker ^entitled The st^ge sequence concept in cognitive an d 



Social development subsequently appeared- in the journal Deveiopmental 



Fsychology . Eli^abethoRi Welfel prepared the third report, Reflective 




1 ) 



/ rjJudRmeiir^fed its relationship to academic field s Project report //4, Mora 

. \ \ ^ 

peasonlng and cpllege^expeyien'ce , was prepared by Joseph M, Volker* 

fames^R. Re^t; prepared the fifth report. Moral dilemmas of young .^dults ^ 
. , Janet A. ^hmidt and Mark L. Davison wrote Does college matter? Reflective 
judgment: How to tackle the tough questions , as the sixth report, a report 
which appeared in Moral Education Forum at the request of the editor. Stephen 
J. Thuma and Mark L. Davison prepared G raduate education, mpfal judgmen t 
development, and e^o development aa an outgrowth of a presentation to the 
Iowa Educational Research and Evaluation convention. And finally, this 



4 



t dp 



report oonstitutes the eighirh and last in our series of project reports. 



Journals and Books 



1i 



"•A segment of Jame&4Cest's recent book. D evelopment in = judgdllng mora 
issues Is devoted to trie relationship between education and moral judgmen't 
development. Two of* phe technical reports have appeared as articles. The 
seconcf report,, "The stagef' sequence concept in cognitive and sotiafl *develof>ment 
appeared in Devel^smifiental Psychology , 1980, jL6, 121-131. The sixth report, 
"Does college m^V^er? Reflective judgment :«> How to tapkle the touglTqtiestians," 
appeared in Moral \ducation Fordm , 1981 ^'(D^ 2-14. Finally, Clyde A. 

Parker authored an al^icle in' the Lyceum , a publicatidn of' the 

h ' ^ ** " 

'iTniversity of/]Minnesot;^ollege of Education. The arti^e was entitled 
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"Teaching students to cope vith uncertainty," Tiie article focused on a 
number of student deve^iLopment^ and faculty development^^ajects^now going 
on at the University qj^ Minnesota, including our project, "Higfie# education 
and cognitive-social development." , * \ * 

Complete citations for the addresses, technical reports, and 
pub^lications are given in appendix B. These reflect our continuing, effort 
to disseminate thG^esults of the project, ' - , ' 



^ ConclusionSL^ ; 

Each of the three stuilies attove .^ummarz^es the unicyie conclusions 
^t;hat follow from it. Rather than recapitulate those conclusions, this 
Action will attempt to integrate them into a pictureQ>f student development 
consistent not only with the data from our own project, but pt^^ peojects 
as well. Gradua^te and^undergraduate education" will^^ considered separately. 

The studies on waich our conclusions '<^re based, including our own 
studies, suffer from methodological flaws. What we ar^ trying to do in this 
s-ection is briefly d^scrl^ the trends in *bhese less than perfect studies and 

*the conclusions supported by the trends. JReaders will no doubt keep in m^nd 

f ^ . . . - 

that the confidence one can place in tKfe trends Is limited by the imperfect 

data base jOn which they rest. <rlfo this section, our focus will be on the 

trends, oot the methodol;ogical short comijigs of the studies. , 

Our conclusions refer only to the variables of this project. For 

instance, our conclusions about moral development refer only to moral 

rTeasoning** as measured by <he Defining Issues Test . Mpral reasoning is. only 



one aVpect of ethical development. Likewise, Reflective Judgment is only 

... 

ope aspect of cognitive development ego development as measured by 

« fc 

r 

Loevinger*s instrifment ^is only one aspect of^ersonality development/ 



Graduate edugatidn » ' ^ ^ 

\. ' ' ' . ^ ■ ' • 

"The ftudies to date -have* consistently found- differences in Reflective 
Judgment ^ Scores between advanced graduate students and beginning graduate 
students (or college students),^ 'This difference remains ev^ after 
controlling for differences (or matching on) verbal ability/' This finding ^ 
is consistent wi'th the idea -that development in reasoning about eomplex 
issu^ havin^no simple right or wrong answer does ^5ccur in graduate school. 
These studies are all cross-sectional. ' 

Do graduate students change in their reasoning at a faster ra^e 
than those not in graduate School? The third study In this report is the 
only one, to out knowledge, to add2;ess this qifestion. The data offered 

, ■ •- . - ■ ■ - • - . r 

'an ambiguous answer* Tlie diffe);^nce between advanced and beginning 
graduate students was greater than tlie corresppndingi^ifference. between 
control groups of nonatfenders of graduate school, but not significantly so. 
' lit the area of moral reasoninej. studies again have consistently foundV a 

' V °' ' ' ■ . ■ • J ^ ^ 

that "advanced graduate students have higher scores than beginning^graduate-y 
students or college seniors. We found in study 3 that the difference between 
advanced and beginning graduate students was greater than the difference 
between nonattending control groups. Jhe re§ult is consistent with the 
notion that those who do and do not attend graduate "schoo*! after college 
develop in moral reasoning, at about the same r4te. ^ ^ ^ "J 

As for ego development, ^here is a growingMe^ody of evidence (Loevinger,* 
1979), including our own study 3,^ to suggest taat there is little change in 
scores on ^Loevinger *s measure beypnd high school either for those in or out 
of s^ool. Hence, there is little to suggest that a graduate educatiion 
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promoCes ggo development as measured by Loevinger's Cest. ^ 

Undergraduate education , . ' « " 

^ The literature tends to show that senior^ have higher Reflective Jodgment 

scores than frcshn\en. The studies are all cross-sectional, howej^er. \^ile 

we had* hypothesized tl\at liberal arts majors should proirlotfe more>**^rowth 

than "narrower" ^technical majors, our Second study did not support this 

hypothesis. The f reshmanTsenior difference was as* wide in engineering as 

^ in the liberal arts. Do people attending college seem to change more 

than those who do not?* There is to date only » one study addressing, this 

issue (Strange, 1978). It suggests that they do. Strange found that 

people differing in age arid education by four yfears, but not those differing 

only in age, had significantly different Reflective Judgment scares. Tais 

study Reserves replication with^ a longitudinal design. . 

J/Uile the Strange study is certainly good news for educators, the 

cogn^itiye complexity of graduating seniors may not be what colleges would 

hope. Senior scores have typically fallen^ in the m^.ddle range where 

responses are characterized by (a) little evaluation of alternative views, 
it. 

(b) a te'ndency to treat all opinions as equally good, (c) 'a tendency to 
use whim and unsubstantiated belief in forming an opinion, and (d)"a * . s 
^he^itancy to take a stance. ^ 

Study 1 not only feonfirms the finding that peopjLe in college grow 
In moral reasoning, it suggests they change faster than* hig;h schoal seniors 
wao *do not attend^olle^^^e.'* Contrary* to the common belief in college 
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two years, the college attenders changed more than nonattend^rs 



student personnel work that the largest jStudent changes occur in the first 
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in the third and fOui^th years beyond ^high school,^ but not in tiie fii^st and 
second years. • The vexing problem, however, remains one of clarifying Tiow 
education has its effi^fs^ 3n moral reasoning., ^ 

As for ego development, „there is relatively little evidence to suggest 
that seniors differ significantly from freshmen. Hence, there is little 
eviden'ce to suggest that undergraduate education has any impaction ego 
development as measured by Loevinger's instrument. 

At Teast at the ujidergraduate level, the evidence to date is consistent 

• • ' ' * % 

with the conclusion that higher education does uave an impact on studenfe 

reasoning about moral issues as measured by the Defining Issues Test an'd ^ 

* • 

students' .reasoning about "complex intellectual issues which have no simple 
right or wrong answer as measured by th€i Reflective Judgment Interview. 
How those effectii occur is not clear. Until we better understand which 
academic and nonacadeijiic experiences mediate the educational effects, ft^ 
will be 'difficult to design curricula specifically to proraote those effects. 
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